Flow owners and admins: see Set up review work for your team at the end of this page.
The flow at a glance
1
See new work
New work items appear in the Inbox in the sidebar and on the flow’s My Work tab.
2
Open My Work
Go to the flow’s My Work tab to see the full queue.
3
Pick your work items
Sort, filter and select the items you want to work on.
4
Enter work mode
Click Enter work mode (multiple items) or Open Work (single item) to review your selection one item after another.
5
Review and correct
Check the extracted values against the document. Arrange the screen the way you like.
6
Complete work
Click Complete work. The flow continues with your corrections and you move on to the next item or, in case there is none, back to My Work.
1. Find out about new work items
The Inbox
The Inbox item in the sidebar shows a red badge with the number of open work items plus unread notifications. When the sidebar is collapsed, the badge is a red dot. Click Inbox to open a drawer with two tabs:- My Work: all your open work items across every flow, grouped by flow. Each item reads “New work item in flow name” and shows when it was created.
- Click an item, or its Open work item arrow, to open it directly.
- Click the Open work queue arrow on a flow’s card to go to that flow’s My Work list.
- Notifications: messages such as being added to a worker group or invited to a flow. Hover a notification to Open it or Mark as read. Use the … menu to Mark all as read.
New work items show up in the Inbox and in My Work as soon as they’re assigned to you. The list updates live, so you don’t need to refresh. Work items don’t create an entry in the Notifications tab and don’t send you an email.
Email alerts
Your flow owner can set up a Human review pending email alert for a flow and add you as a recipient. The email lists the runs waiting for review and has an Open My Work → button that takes you straight to that flow’s My Work list.2. Open My Work
My Work is a tab on each flow’s page. You can open it only when the flow has at least one Human-in-the-loop task assigned to you. The red badge on the tab shows how many open work items are assigned to you in this flow. If nothing is assigned to you, the tab has no badge and the list shows “No work assigned”.- Open the flow, from the Inbox or from Hub.
- Click the My Work tab at the top of the page. The red badge on the tab shows how many open items you have in this flow.
What you see in the list
The list shows the work items that are assigned to you, directly or through a worker group, and that are waiting for review. It doesn’t show:- items another worker is reviewing right now;
- completed or cancelled items.
| Column | What it shows |
|---|---|
| Files | The file names of the run’s input. |
| Tags | Tags on the run. |
| Metadata | Metadata of the run, as key: value badges. Hover to see all. |
| Source Task Name | The step whose output you’re reviewing. Hover a row to see the Open Work button. |
| Target Task Name | The step that receives your reviewed output. |
| Created | When the work item was created. |
| Updated | When the work item was last updated. |
| Run ID | The ID of the flow run. Hover to copy it. |
Sort the list
Click the sort button in the toolbar. It shows the field you’re sorting by and you can pick a field and a direction:| Field | Directions |
|---|---|
| Created at | Oldest first / Newest first |
| Updated at | Oldest first / Newest first |
| Source Task Name | A to Z / Z to A |
| Run created at | Oldest first / Newest first |
Filter the list
Click Filter and choose a field. Filters apply as soon as you set a value. With more than one filter, an item must match all of them.- Tags: choose contain one of, contain all of or do not contain, then pick tags.
- Run ID: paste the full run ID from the Run ID column and press Enter.
- Metadata: pick a key, then one or more values. An item matches if it has any of the chosen values. Add more metadata filters to narrow further.
Customize columns
Click Customize columns to open the columns drawer.- Click the eye icon to show or hide a column, or use Show all / Hide all.
- Drag a column to change its position.
- Use Search for a column to find one quickly.
- Drag the right edge of a column header to resize it.
- Hover a header and use the pin to Freeze Left, Freeze Right or Unfreeze a column.
Pages
Choose 10, 25 or 50 Items per page at the bottom of the list. Your choice is saved to your account.3. Select work items
When the list loads, every item on the current page is selected. New items that arrive while you’re on the page are selected too, until you change the selection yourself.- Click an item’s checkbox to select or unselect it.
- Click the checkbox in the header to select or unselect the whole page.
- In the selection bar, use Select all or Unselect all.
4. Start the review
You can open work items in two ways:Work mode (recommended)
Select items and click Enter work mode. You review them one after another. After each Complete work, the next item opens.
A single item
Click a row, or hover it and click Open Work. This opens just that item, without a queue.
Work mode
In work mode, the page has an orange frame with a Work mode label at the top. The label holds the queue controls:- “i / n items”: where you are in your queue.
- Previous work item / Next work item arrows, or press ↑ / ↓. The arrows wrap around from the last item to the first.
- Work queue settings (gear icon). See below.
- Exit: go back to the My Work list. Your filters and sort are kept.
Work queue settings
Click the gear icon in the Work mode label. Under Skip items that are, choose which items the arrows and Complete work jump over:| Setting | Skips items that… | Default |
|---|---|---|
| Completed | someone has already completed | On |
| Cancelled | were cancelled, for example because the run was stopped | On |
| Being worked on | another worker has open right now | On |
5. The review screen
From top to bottom, the review screen has:- Breadcrumb: Hub › flow name › My Work › Task details.
- Work mode label, centered at the top, when you’re in work mode: the item counter, the previous/next work item arrows, Work queue settings (gear icon) and Exit. See Work mode.
- Sub-header:
- On the left, a task switcher. Use Previous task / Next task, the dropdown, or ← / →, to look at the other steps of the same run, read-only. If the run has only one step, its name is shown instead.
- On the right, Layout (when the work item has more than one task detail), Task Detail, and a button to Hide page details for more space.
- Status and actions: tags, badges such as Stale or Edited, the Unsaved changes indicator and Complete work.
- Messages (optional): shown only when they apply to the work item, for example validation messages or a notice that someone else is reviewing it. Many work items have none.
- Task details: one or more task details, each showing the output of a step in the flow. Each one is marked Editable or Read-only:
- Editable task details are the ones you review and correct.
- Read-only task details are there for context, for example an earlier step’s output that helps you decide. You can’t change them. A work item can have one or several editable task details, with or without read-only ones for context. Click a task detail’s header to collapse or expand it.
Instructions and notes
Click Task Detail to open a side panel with three tabs:- Instructions: the general instructions for the review, validation descriptions, and Field instructions grouped by step. Click the eye icon next to a field instruction to jump to that field.
- Notes: notes on this work item. Type in Add a note… and click Add note. You can edit or delete your own notes. Other reviewers see them too.
- Metadata: details about the run and the review, such as its status and who last updated it. Fields with instructions show an info icon next to their name. Hover it to read the instructions, or click See all instructions.
Validation messages
If the flow found problems with the output, a banner shows how many validations need attention. Step through them with Next message / Previous message, or click See all. Fields, values, table rows or cells with a problem have a red outline. The outline clears when you change the value.6. Adjust the view
You can set up the review screen to suit the documents you work on. Layout choices are saved in your browser and come back the next time you review.Expand an item
Click Expand in a task detail’s header to open it almost full screen. If the work item has several task details, use Previous task output / Next task output to move between them while expanded. Click Minimize or press Esc to go back.Arrange the extraction fields
On extraction tasks, the extracted fields sit next to the document.- Resize: drag the divider between the fields and the document.
- Move left / Move right: put the fields on the other side of the document.
- Hide extractions: collapse the fields to a narrow Extractions bar to give the document more room. Click the bar to open the fields again.
Arrange the tables
Extracted tables can sit inside the field list, below the document, or in their own column. Use the buttons on a table, or in the table area:| Option | Where tables go |
|---|---|
| Split down | In a panel under the document and fields, with one tab per table. |
| Split right | In a separate column on the right. |
| Click the active option again (Show tables in the field list) | Back inside the field list. |
- Click a table’s tab to open it. Click the open tab again to collapse the panel.
- Use Expand / Collapse, or press Alt+T (⌥+T on Mac).
- Press Alt+1 to Alt+9 to open table 1 to 9.
- Drag the edge of the panel to resize it. Tables inside the field list show 5 rows. Click See all n rows to see the rest.
Move left / Move right isn’t available while tables are in Split right.
Work items with several task details
A review step can be set up to show more than one task detail in a work item, for example the outputs of several extraction steps, or an extraction plus the classification that came before it. The screen then works a little differently than with a single task detail.Collapse and expand task details
- By default, only the first task detail is expanded. Click any header to expand or collapse it.
- You can expand several task details at the same time, or collapse all of them.
- When one task detail is expanded, it fills the available height. When two or more are expanded, each gets a fixed height and the page scrolls.
The Layout menu
Click Layout in the sub-header. Under Task Execution Sources, each task detail has a row. Click the chevron on a row (Expand options) to see its options:- Drag to reorder: drag the handle to change the order of the task details on the screen.
- Show: turn it off to hide a task detail. Hidden task details are dimmed in the menu.
- Width: Full or Half. Two half-width task details that follow each other sit side by side. A half-width task detail next to a full-width one, or left over at the end, is shown at full width.
- Inputs: show or hide the step’s inputs. Only some task types have this option. Extraction task details don’t. Click Reset to go back to the default: the order set up in the flow, everything shown at full width, and only the first task detail expanded.
You can hide every task detail. If the review area is empty, open Layout and turn Show back on, or click Reset.
Resize task details
- Side by side: drag the divider between two half-width task details. It snaps to 25%, 33%, 50%, 67% or 75%.
- Height: when two or more task details are expanded, drag the bottom edge of a task detail to change its height. Double-click the edge to reset it.
What’s shared and what’s saved
- Your layout (order, Show, Width, Inputs, which task details are expanded, and sizes) is saved in your browser for that review step. It applies to every work item of that step.
- Extraction settings, such as where tables go (Split down / Split right) and which side the fields are on, apply to all task details at once, not to one.
- If several task details have a table panel, Alt+T and Alt+1…9 act on the one you last clicked.
- Which task details are Editable and which are Read-only, and their default order, are set by your flow owner.
Work with the document
The document toolbar has:- View: switch between Reference Doc, Reference Text and Output JSON.
- Bounding boxes: Extracted Bounding Boxes shows where each value was found, Draw Bounding Box lets you draw new ones, No Interactions turns both off.
- Zoom in / Zoom out and a zoom level from 25% to 500%. Reset view resets zoom and rotation. When zoomed in, drag the page to move around.
- Rotate left / Rotate right.
- Expand document: opens a large preview where you can also tilt the page and zoom with +, −, 0, or Ctrl/⌘ + scroll.
- Download file.
- Show pages for thumbnails, and page arrows or a page number to move between pages. On a narrow screen, some of these move into the More document options menu.
7. Review and correct
Fields
Edit a value
Click a value, type, then press Enter or click elsewhere.Use the expected format
Each field has a type, set by your flow owner. Enter values in the format the field expects:| Field type | What to enter |
|---|---|
| Text | Any text. |
| Whole number | A number without decimals, for example 42. |
| Decimal number | A number, for example 1234.56. |
| Single choice | Pick one value from Select a value. |
| Multiple choice | Pick one or more values from the list. |
Single-value fields
Some fields accept only one value. They’re marked with a* after the value count next to the field name, for example (1*). Hover it to see “This field is restricted to a single value.” Single-choice fields always work this way. Once the field has a value, Add new item is greyed out. To replace the value, edit it, or delete it and add a new one.
Add a value
- Click Add new item next to the field name. The field shows “Draw a bounding box around the extraction”.
- Draw a box around the value on the document. See Draw bounding boxes.
- Or type the value yourself.
Item options
Click the three dots (Item options) next to a value:- Page: n: the page of the document the value was found on.
- Confidence: n%: how confident the model was about the value. Shown only when the model returned a confidence.
- Abstracted: tick or untick to mark whether the value was inferred rather than copied from the document.
- Delete: remove this value. To remove every value of a field at once, use Delete all items next to the field name. This happens right away, without a confirmation.
Badges on AI output
- A (Abstracted): the value was inferred, not copied, so it may not appear word for word on the document. Click the badge for details, or to Remove abstracted label. A strip at the top lets you step through all abstracted values.
- Lightbulb (AI reasoning): shows how the model arrived at the value.
Draw bounding boxes
When the original document is shown in the viewer, you can take values straight from it by drawing a box around them. The text inside the box is read for you. For a field- Click Add new item next to the field. Or, in the document toolbar, switch to Draw Bounding Box and draw anywhere on the document.
- Drag a box around the value on the document.
- A form opens:
- Field Key: the field the value belongs to. It’s already filled in if you started from Add new item; otherwise pick it under Select a field.
- Field Value: the text read from the box (“Extracting text…”). Check it and correct it if needed. If the text can’t be read, you’ll see “Could not extract text automatically. Please type the value.”
- Click Submit, or Cancel to discard the box. For a table cell
- Hover the cell and click the draw icon that appears on its right. The cell shows “Draw a bounding box…”.
- Drag a box around the value on the document. The text fills the cell.
- To stop without drawing, click the X in the cell.
Tables
- Edit a cell: click it, type, then press Enter or click elsewhere. The same format rules apply as for fields.
- Fill a cell from the document: see Draw bounding boxes.
- Select: drag across cells, Shift+click to extend, or click row numbers to select whole rows. Esc clears the selection.
- Copy a value to other cells: drag the small handle on a selected cell.
- Right-click a row for more:
- Show in document
- Insert row above / Insert row below
- Clear cell, Delete row
- Fill down / Fill up, which only fill empty cells
- Fill to bottom / Fill to top, which overwrite filled cells
- Right-click below the rows for Insert row to top / Insert row to bottom. Deleting, clearing and overwriting ask you to confirm, because they can’t be undone. Table columns come from the field setup and can’t be added or removed during review.
Document classification
In a classification review, the flow has split an uploaded file into separate documents and given each one a document type. You check that the pages are grouped correctly and that each group has the right type.What you see
- Splits: each detected document is a split, shown as a box with its pages as thumbnails, in order. The split’s header shows its name (for example
invoice_1), a Rotate all pages 90° button and its document type. - Header bar: the original file name (click it to view the whole file), Group Splits, the filter icon and the zoom icon.
Arrange the view
- Group Splits: on (the default), splits are grouped under one heading per document type. Off, all splits are shown in one list.
- Filter by document type (filter icon): under Document Types, pick the types to show. Leave it empty to show all.
- Zoom (magnifier icon): choose a thumbnail size from 50% to 300%.
Change a document type
Pick the right type in the split’s Select document type list. You can search the list. Only the document types configured for the flow are available. The change applies to all pages of the split.Fix how pages are split
Right-click a page thumbnail to open its menu:| Action | What it does |
|---|---|
| Move as previous page | Moves the page one position earlier in its split. |
| Move as next page | Moves the page one position later in its split. |
| Add to new split | Takes the page out into a new split of its own. |
| Add to prev split | Moves the page to the end of the previous split. |
| Add to next split | Moves the page to the end of the next split. |
| Rotate 90° | Rotates the page. |
With Group Splits on, Add to prev split and Add to next split move the page to the neighbouring split of the same document type. With it off, they move it to the split shown just before or after.
- Merge two splits: move the pages of one split into the other. A split with no pages left disappears.
- While a move is processed, the page shows “Repositioning…” or “Removing…”, the target split shows “Adding…”, and the split header shows “Updating…”. Wait until it’s done before you click Complete work. If you try to leave while a move is still processing, you’ll see “Changes might not be saved”. Choose Cancel to stay until it finishes.
Rotating pages, with Rotate 90° or Rotate all pages 90°, changes only how the pages are shown to you while you review. It isn’t saved with your result.
Look at a page closely
Click a page thumbnail to open the page preview:- Split at the top: jump to another split, or press ↑ / ↓.
- Document type: change the type of the current split from here. The list tells you how many pages it applies to.
- Previous page (←) / Next page (→): move through the pages of the current split, shown as “Page i / n”.
- Actions: the same page actions as the right-click menu.
- Zoom, rotate and tilt the preview with the toolbar, or zoom with + / − and reset with 0.
Other review types
Depending on the flow, you may review other kinds of steps. The same work mode, notes and Complete work apply to every type, and your changes are submitted only when you click Complete work.For branch and collection validation steps, your flow owner can set up the review to show only one branch or one result. In that case you see the screen of the step that produced the data, for example the extraction screen, instead of the screens described below.
Document to text
The step turned a document into text. You check and correct that text.- Inputs on the left shows the original document. Outputs on the right shows the extracted text in an editor.
- The editor shows one page at a time. Use the arrows or type a number in Page n of N to move between pages. The document viewer has its own page controls.
- Click into the text and correct it. Hovering over the text highlights the passages it’s made of.
- Only plain text is kept. Formatting such as bold or italic isn’t saved.
Image rotation
The step checked that an image or PDF is the right way up and turned it if needed.- Input shows the original file. Output shows the result.
- The Rotated indicator shows whether the file was turned. You can’t change it directly.
- Click the rotate button next to it to turn the output 90° clockwise. Click again to keep turning. For a PDF, all pages turn together.
- Some image formats are saved as PNG or JPEG after rotating.
Branch
The step sent each item down one or more branches, based on conditions set up in the flow.- Inputs shows the Branches, each with its Branch Name, Branch Condition Type (IF, ELIF or ELSE) and conditions, and the Input Collection.
- Outputs shows each branch with the items that went down it. A branch without items shows “There are no outputs for this branch.”
- To send items down a different branch, click Change Branch under the branch and pick the branch they should go to.
Item validation
The step checked one item against validation rules.- Inputs shows the Validation Rules and the Input Values that were checked.
- Outputs shows the Validation Status. Validation Passed is True if all rules passed, False if any failed. When it’s False, Validation Details lists the failed rules and their messages.
- To override the result, turn the Validation Passed switch. Turning it to True lets the item continue as valid. You can’t edit single rules or messages.
Collection validation
The step checked a whole collection, such as all rows of a table, against rules like “not empty” or a minimum and maximum length.- Inputs shows the Validation Rules and the Input Collection.
- Outputs shows the Validation Status and, when it failed, the Validation Details.
- To override the result, turn the Validation Passed switch. The result applies to the whole collection. You can’t mark single items as valid or invalid.
8. Complete work
When you’re done with an item, click Complete work in the top right.- Your changes are submitted and you’ll see “Review completed successfully”.
- The flow run continues with your reviewed output.
- In work mode, the next item in your queue opens. If you opened a single item, you go back to My Work.
If several people are assigned to the same item, the first one to complete it wins. Everyone else sees it as Work completed and can no longer change it.
Leave without completing
Click Exit, the breadcrumb, or move to another item. If you have unsaved changes, you’ll be asked Discard unsaved changes?. Choose Keep editing to stay, or Discard to leave. The item is released for others.Stepping away
After an item has been open for 15 minutes, you’ll be asked Are you still there?. Click Continue to keep reviewing, or Exit review. If you don’t answer, you’re taken back to My Work after 30 minutes and the item is released, so it doesn’t stay blocked for your team.9. Re-run or cancel a run
Sometimes a work item can’t be fixed by reviewing it. For example, the wrong document was uploaded, or the flow was updated and the run should be processed again. For these cases you can re-run or cancel the whole run that the work item belongs to.Re-run and Cancel run are only shown if your role allows you to manage flow runs. If you don’t see them, ask your admin.
Where to find them
| Where | Buttons | Applies to |
|---|---|---|
| My Work list, in the selection bar | Re-run (n) and Cancel runs (n) | All runs of the selected work items. n counts runs, not work items: two work items from the same run count as one. |
| Review screen (Task details), top right next to Complete work | Re-run and Cancel run | The run of the work item you have open. |
Re-run
Re-running processes the run again from its steps, so the AI output you review is produced again.- Click Re-run (n) in the selection bar, or Re-run on the review screen.
- In the Re-run Settings dialog, choose which tasks to run again:
- All tasks: every step of the run is processed again. This is selected by default.
- Only stale tasks: only the steps marked Stale are processed again. A step is stale when an earlier step’s output was edited. If the flow was updated since the run was processed, the steps affected by those changes, and the steps after them, are re-run too.
- Click Re-run to start, or Cancel to close the dialog without re-running.
- You’ll see “Re-running n runs…”, then “Successfully re-run all runs.”. If some runs couldn’t start, a message says how many failed, with an option to retry them.
- Open work items on re-run steps are reset for every reviewer. Any unsaved changes on them are lost. When the re-run reaches the review step again, the work item comes back in My Work.
- On the review screen in work mode, you move on to the next item in your queue. Otherwise you go back to My Work.
Cancel a run
Cancelling stops the run. The flow doesn’t continue past the review step, and the run’s work items are removed for everyone.- Click Cancel runs (n) in the selection bar, or Cancel run on the review screen.
- A confirmation dialog opens:
- From the selection bar: Cancel 1 run? or Cancel n runs?, with “This stops the selected runs and removes their work items for every reviewer.”
- From the review screen: Cancel this run?, with “This stops the run and removes all of its work items for every reviewer.”
- Click Cancel runs / Cancel run to confirm, or Go back to keep the run.
- You’ll see “Run cancelled” (or “n runs cancelled”). If some runs couldn’t be cancelled, a message says how many failed.
- The run’s work items disappear from My Work for every reviewer.
- On the review screen in work mode, you skip every remaining item from that run and move on to the next one. Otherwise you go back to My Work.
Messages you may see
This task is being reviewed by …
This task is being reviewed by …
A colleague opened this item before you. You can look at it but not edit it. Click Go to next to move on.
This review was reset by a new run.
This review was reset by a new run.
Someone re-ran the flow while you had this item open, so your changes were discarded. When the new run reaches this step, the item comes back. Click Check again or Go to next.
This task was cancelled.
This task was cancelled.
The run was stopped. Click Go to next to move on.
Work item not found
Work item not found
The item is no longer available, often because a newer run of the flow replaced it. Click Skip to next work item.
This task is not part of your work queue
This task is not part of your work queue
You opened an item that isn’t in your current work mode queue, for example from the Inbox. Use the arrows to go back to your queue, or Exit.
This task output is marked as stale and needs to be re-run.
This task output is marked as stale and needs to be re-run.
An earlier step changed after this output was produced. Click See details to learn more, or Re-run task to run the step again.
Complete work is greyed out
Complete work is greyed out
The item is already completed, cancelled or open by someone else, you’re looking at another step of the run, or the review has values that need fixing (for example highlighted invalid cells).