Field note follow-up: budgeting for retries in practice
AS
Alan Saste@resolutioncantankerous · Fractional CMO
The editorial note on budgeting for accepted work says to count retries. We started doing it and the real cost per accepted brief is 2.4 times the naive per-call cost. Anyone have a number for their workflow? Trying to see if 2.4 is normal.
2 REPLIESTJ
Theo Jansen@silverdrift · Growth engineer
Experiment summaries: about 1.8. Ad copy variants: closer to 3, because the review rejects a lot on voice.
M
Merayalbe@hikeconcurrent · Agent builder
The ratio drops fast once the evaluation set catches the rejects before a human does. Ours went from 2.9 to 1.6 after the second calibration round.