> ## Documentation Index > Fetch the complete documentation index at: https://docs.platform.toloka.ai/docs/llms.txt > Use this file to discover all available pages before exploring further. # List the reviews of a run > Only teams with customer review enabled: other teams get `403 The "customerReview" feature is not enabled for this team`. Return a page of the customer reviews of a run, without task content. Deciding a review moves it out of `awaiting`, so to work through the queue, decide the first page and list again from offset 0. ## OpenAPI ````yaml /api-reference/openapi.json get /runs/{runId}/reviews openapi: 3.1.0 info: description: >- Manage projects, datasets, labeling pipelines, and model training. **Beta:** endpoints, request and response shapes, and error contracts can change without notice or a backward-compatibility promise. title: Toloka Platform API version: 2.0.0 servers: - url: https://platform.toloka.ai/api/v2-beta security: - apiKeyAuth: [] - scopedTokenAuth: [] tags: - description: The authenticated API key owner. name: Account - description: A project is the container for pipelines, datasets, and files. name: Projects - description: Rows and typed fields. Field schemas are immutable once created. name: Datasets - description: Append rows to a dataset from a file. name: Dataset uploads - description: Read a dataset out as a file. name: Dataset exports - description: A pipeline is a graph of nodes that processes each dataset item. name: Pipelines - description: The nodes, connections, fields, and version of a pipeline graph. name: Pipeline graph - description: Execute a pipeline over a dataset and inspect each item. name: Runs - description: >- Only for teams with customer review enabled. Customer review of generation tasks: the team accepts or rejects every task of a node that uses customer review. name: Reviews - description: Per-node checks that a pipeline must pass before deployment. name: Checks - description: Named credentials available to pipeline code. name: Secrets - description: Project files available to pipeline code and labeling interfaces. name: Files - description: >- Global, read-only catalog of the models a synthetic generation node can use, with their budget bounds. name: Generation models - description: >- Global, read-only catalog of the expert audience: the values a node `audience` filter can use. name: Audience - description: Project lists of experts a node can take its workforce from. name: Expert lists - description: >- Experts banned in a project: they cannot be invited and are removed from the work they are in. Available only to teams with expert lists enabled. name: Expert ban list - description: Global, read-only base model catalog. name: Base models - description: Project-owned mutable model-training drafts. name: Trainings - description: Project-owned Models and immutable Model Versions. name: Models - name: Batch inference paths: /runs/{runId}/reviews: get: tags: - Reviews summary: List the reviews of a run description: >- Only teams with customer review enabled: other teams get `403 The "customerReview" feature is not enabled for this team`. Return a page of the customer reviews of a run, without task content. Deciding a review moves it out of `awaiting`, so to work through the queue, decide the first page and list again from offset 0. operationId: listPipelineRunReviews parameters: - in: path name: runId required: true schema: $ref: '#/components/schemas/RunId' - description: Maximum number of results to return; defaults to 20. in: query name: limit schema: default: 20 maximum: 100 minimum: 1 type: integer - description: Number of results to skip before this page; defaults to 0. in: query name: offset schema: default: 0 maximum: 9007199254740991 minimum: 0 type: integer - description: >- Which reviews to list. `awaiting`: reviews that still take a decision (`needs_review` and `returned` before their deadline), soonest deadline first. `checking`: rejects the LLM QA check is checking, soonest deadline first. `closed`: accepted, rejected and expired reviews, most recently closed first. Defaults to `awaiting`. in: query name: status schema: default: awaiting enum: - awaiting - checking - closed type: string - description: Only list the reviews of this generation node. in: query name: nodeId schema: type: string responses: '200': content: application/json: schema: properties: pagination: $ref: '#/components/schemas/Pagination' reviews: description: Reviews in this page. items: $ref: '#/components/schemas/ReviewSummary' type: array required: - reviews - pagination type: object description: A page of reviews headers: RateLimit-Limit: $ref: '#/components/headers/RateLimit-Limit' RateLimit-Policy: $ref: '#/components/headers/RateLimit-Policy' RateLimit-Remaining: $ref: '#/components/headers/RateLimit-Remaining' RateLimit-Reset: $ref: '#/components/headers/RateLimit-Reset' X-Request-Id: $ref: '#/components/headers/X-Request-Id' '403': description: >- Customer review is not enabled for the team of the run, or the scoped token lacks the needed `review` permission. Deciding needs `review:write`, which every preset except `read` and `labeling-read` includes. headers: RateLimit-Limit: $ref: '#/components/headers/RateLimit-Limit' RateLimit-Policy: $ref: '#/components/headers/RateLimit-Policy' RateLimit-Remaining: $ref: '#/components/headers/RateLimit-Remaining' RateLimit-Reset: $ref: '#/components/headers/RateLimit-Reset' X-Request-Id: $ref: '#/components/headers/X-Request-Id' '404': description: Run not found headers: RateLimit-Limit: $ref: '#/components/headers/RateLimit-Limit' RateLimit-Policy: $ref: '#/components/headers/RateLimit-Policy' RateLimit-Remaining: $ref: '#/components/headers/RateLimit-Remaining' RateLimit-Reset: $ref: '#/components/headers/RateLimit-Reset' X-Request-Id: $ref: '#/components/headers/X-Request-Id' '429': description: Rate limit exceeded headers: RateLimit-Limit: $ref: '#/components/headers/RateLimit-Limit' RateLimit-Policy: $ref: '#/components/headers/RateLimit-Policy' RateLimit-Remaining: $ref: '#/components/headers/RateLimit-Remaining' RateLimit-Reset: $ref: '#/components/headers/RateLimit-Reset' X-Request-Id: $ref: '#/components/headers/X-Request-Id' x-codeSamples: - label: TypeScript SDK · all pages lang: typescript source: | import { createClient } from "@toloka-platform/sdk"; const client = createClient({ baseUrl: "https://platform.toloka.ai", apiKey: process.env.TOLOKA_API_KEY!, }); for await (const item of client.reviews.listAll({ runId: "plr.019a0000-0000-7000-8000-000000000001" })) { console.log(item); } - label: TypeScript SDK · one page lang: typescript source: | import { createClient } from "@toloka-platform/sdk"; const client = createClient({ baseUrl: "https://platform.toloka.ai", apiKey: process.env.TOLOKA_API_KEY!, }); const page = await client.reviews.listPage({ runId: "plr.019a0000-0000-7000-8000-000000000001" }); console.log(page); components: schemas: RunId: description: Pipeline run ID with prefix `plr.`. pattern: >- ^plr\.[0-9a-f]{8}-[0-9a-f]{4}-[7][0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$ type: string Pagination: description: Pagination information for this page. properties: hasMore: description: Whether more matching results follow this page. type: boolean limit: description: Maximum number of results requested for this page. example: 20 maximum: 9007199254740991 minimum: -9007199254740991 type: integer offset: description: Number of results skipped before this page. example: 0 maximum: 9007199254740991 minimum: -9007199254740991 type: integer total: description: Total number of matching results. example: 42 maximum: 9007199254740991 minimum: -9007199254740991 type: integer required: - total - limit - offset - hasMore type: object ReviewSummary: description: A customer review of one task, without its content. properties: closedAt: anyOf: - format: date-time pattern: >- ^(?:(?:\d\d[2468][048]|\d\d[13579][26]|\d\d0[48]|[02468][048]00|[13579][26]00)-02-29|\d{4}-(?:(?:0[13578]|1[02])-(?:0[1-9]|[12]\d|3[01])|(?:0[469]|11)-(?:0[1-9]|[12]\d|30)|(?:02)-(?:0[1-9]|1\d|2[0-8])))T(?:(?:[01]\d|2[0-3]):[0-5]\d:[0-5]\d(?:\.\d+)?(?:Z))$ type: string - type: 'null' description: >- Time the review closed, as an ISO 8601 timestamp, or null while it is open. deadlineAt: description: >- Deadline for a decision, as an ISO 8601 timestamp. From then on the review takes no decisions, but it closes a little later: a review waiting for a decision expires shortly after the deadline, and its task is accepted automatically (the expert is paid and the task is billed); a review checking a reject closes when the LLM QA check answers. format: date-time pattern: >- ^(?:(?:\d\d[2468][048]|\d\d[13579][26]|\d\d0[48]|[02468][048]00|[13579][26]00)-02-29|\d{4}-(?:(?:0[13578]|1[02])-(?:0[1-9]|[12]\d|3[01])|(?:0[469]|11)-(?:0[1-9]|[12]\d|30)|(?:02)-(?:0[1-9]|1\d|2[0-8])))T(?:(?:[01]\d|2[0-3]):[0-5]\d:[0-5]\d(?:\.\d+)?(?:Z))$ type: string id: $ref: '#/components/schemas/ReviewId' itemId: $ref: '#/components/schemas/RunItemId' nodeId: description: ID of the generation node whose task is under review. type: string nodeName: description: Name of that generation node. type: string runId: $ref: '#/components/schemas/RunId' status: $ref: '#/components/schemas/ReviewStatus' submittedAt: description: Time the task was submitted, as an ISO 8601 timestamp. format: date-time pattern: >- ^(?:(?:\d\d[2468][048]|\d\d[13579][26]|\d\d0[48]|[02468][048]00|[13579][26]00)-02-29|\d{4}-(?:(?:0[13578]|1[02])-(?:0[1-9]|[12]\d|3[01])|(?:0[469]|11)-(?:0[1-9]|[12]\d|30)|(?:02)-(?:0[1-9]|1\d|2[0-8])))T(?:(?:[01]\d|2[0-3]):[0-5]\d:[0-5]\d(?:\.\d+)?(?:Z))$ type: string required: - id - runId - itemId - nodeId - nodeName - status - submittedAt - deadlineAt - closedAt type: object ReviewId: description: Review ID with prefix `trr.`. pattern: >- ^trr\.[0-9a-f]{8}-[0-9a-f]{4}-[7][0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$ type: string RunItemId: description: Run item ID with prefix `plri.`. pattern: >- ^plri\.[0-9a-f]{8}-[0-9a-f]{4}-[7][0-9a-f]{3}-[89ab][0-9a-f]{3}-[0-9a-f]{12}$ type: string ReviewStatus: description: >- Review status. `needs_review`: waiting for the first decision. `returned`: the LLM QA check did not confirm the last reject, so the review waits for a new decision. `checking`: the LLM QA check is checking a reject, and decisions are refused until it answers. `accepted`: the team accepted the task. `rejected`: the reject is final, either forced or confirmed by the LLM QA check. `expired`: the deadline passed while the review was open, whether it waited for a decision or was checking a reject the check then did not confirm, so the task was accepted automatically. enum: - needs_review - returned - checking - accepted - rejected - expired type: string headers: RateLimit-Limit: description: The maximum number of requests allowed in the current window. schema: type: integer RateLimit-Policy: description: The rate limit policy (e.g., "60;w=60"). schema: type: string RateLimit-Remaining: description: The number of requests remaining in the current window. schema: type: integer RateLimit-Reset: description: The number of seconds until the current window resets. schema: type: integer X-Request-Id: description: >- The request id: the X-Request-Id you sent when it is 1-128 characters of letters, digits, ".", "_" or "-", otherwise a generated UUID. Present on every response, including errors; quote it when reporting a problem. schema: type: string securitySchemes: apiKeyAuth: description: >- Enter `ApiKey ` in Authorization, including the `ApiKey ` prefix. In cURL and Python samples, `` means this full value. The TypeScript SDK adds the prefix for you. in: header name: Authorization type: apiKey scopedTokenAuth: description: >- Enter the project-scoped token as `pst_...` in X-Scoped-Token, without an `ApiKey ` prefix. Create a token with POST /projects/{projectId}/tokens. in: header name: X-Scoped-Token type: apiKey ```` This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.