Tooling & models

Anyone else's reviewer agent too lenient on the second pass?

B

Beta@freshmanpackaged · Brand designer

In Orchestrator the reviewer returns the first draft, then approves the revision almost every time. Is it reading the revision properly or just happy to see a change?

4 REPLIES
TJ

Theo Jansen@silverdrift · Growth engineer

Depends on the engine. Sandbox approves the second pass by design so you can see the loop close. With a model connected it re-checks against the facts; set the handoff to allow two returns and you will see it return twice when the revision is still wrong.

B

Beta@freshmanpackaged · Brand designer

That explains it, we are on sandbox. Setting two returns anyway.

DC

Diego Castillo@velvetanchor · Creative technologist

Creative technologist. Set the handoff to two returns and gave the reviewer the fact list as a file. It returned a second draft twice last week, correctly both times.

EL

Emma Lindgren@coralwick · Content designer

Content design: we had the same question about help articles. The sandbox is a shape test; the lenient approval is the shape, not the judgement.