Reviews and feedback

Give feedback on a Coworker's replies, and work through that feedback from the Supervisor dashboard.

For: Anyone who chats with a Coworker; working through feedback needs its Supervisor · Last updated

Feedback from the people who use a Coworker is what its Supervisor works from. The Supervisor reads that feedback one item at a time, adjusts the Coworker and marks how each item turned out.

Giving feedback#

Under each reply from a Coworker in chat are a thumbs-up and a thumbs-down.

  • Select the thumbs-up when the reply was good.
  • Select the thumbs-down when it was not. You can then pick the kind of problem, from Not sure (the default), Hallucination, Stale data, Misread, Gap and Error or failure, and describe the problem in the "What went wrong?" box. Select Send.

Anyone who can chat with a Coworker can give feedback on its replies. A thumb you give is counted on its own: that conversation is not also reviewed automatically. Your Coworker's Supervisor can read conversations that have been flagged, as part of reviewing the Coworker.

How helpful the Coworker has been#

Besides thumbs, a sample of a Coworker's finished interactions is reviewed automatically to estimate how often people were helped, and for which of its duties. The result is the Helped figure on the Signals card of the Coworker's details page, next to the thumbs-up rate. It is visible to the Supervisor and to admins and executives; see Coworker details. The Supervisor can also open the interactions that went badly from there, and select Review conversations now there.

Where a Supervisor works through feedback#

A Supervisor opens the Coworker dashboard from Manage, then Coworkers. Feedback to review there lists the thumbs-down and flagged thumbs-up feedback the Supervisor has not marked, newest first. Select an item to read its conversation right under it, then say how it turned out. The message that was rated is marked with a thumb icon in the conversation.

For the fuller page, with themes, filters and the automatic-review reasons, open a Coworker's details page and select a reason on its Signals card. The page is titled with the Coworker's name and works through the feedback one item at a time. Only the Coworker's Supervisor can read its feedback and mark items. If you are someone else, the page tells you that working through feedback requires being the Supervisor.

Working through the feedback#

Feedback to work through is one list of everything that went wrong and has no marker: every thumbs-down and flagged item from users, and every interaction automatic review judged did not help the person (tagged Automatic review, with the reason). The list is grouped into themes by the weekly feedback synthesis, and Run synthesis now runs one straight away. Items that are not in a theme are listed last under Not in a theme. A line above the list shows your progress, such as "3 of 8 worked", and menus narrow the list by status and by reason.

Select an item to open its conversation right under it, then try to reproduce the problem and fix the Coworker the way you normally would. Two links at the top of the page, Open chat with the Coworker and Coworker details, open a chat and the details page (where instructions and Knowledge Bases are edited) in a new tab, so you keep your place.

Marking each item#

Under the conversation, choose how the item turned out: Fixed, Could not reproduce, Transient error, Not fixable, Not a problem or Other, add a comment if you like (it is required for Other), and select Save, or Save and open next to move on to the next item that has no marker. An item with no marker shows Open. Mark as open removes a marker. Markers stay with the Coworker. See Working through feedback for the full page.

Marking items does not change the Coworker's phase; to advance or retire it, see Advancing a Coworker and retiring it.