Anyone else's reviewer agent too lenient on the second pass?
In Orchestrator the reviewer returns the first draft, then approves the revision almost every time. Is it reading the revision properly or just happy to see a change?
In Orchestrator the reviewer returns the first draft, then approves the revision almost every time. Is it reading the revision properly or just happy to see a change?
Depends on the engine. Sandbox approves the second pass by design so you can see the loop close. With a model connected it re-checks against the facts; set the handoff to allow two returns and you will see it return twice when the revision is still wrong.
That explains it, we are on sandbox. Setting two returns anyway.
Creative technologist. Set the handoff to two returns and gave the reviewer the fact list as a file. It returned a second draft twice last week, correctly both times.
Content design: we had the same question about help articles. The sandbox is a shape test; the lenient approval is the shape, not the judgement.