The Judge-Generator Split Is the Real Bottleneck in Self-Improvement
Why it earned a slot
Across five papers—OPD, PaperGym, S3Gym, Aspire, and WebWorld—the same structural problem keeps surfacing: the entity doing the improving is also the entity doing the judging. In OPD, the teacher model's noise propagates into the student because there's no independent critic. In WebWorld, the model that proposes a repair is the same model that judges visual plausibility, which is a poor proxy for correctness. In S3Gym and Aspire, models must self-test and self-evaluate against goals they themselves must interpret. The pattern is unmistakable: we've solved the optimization half of self-improvement (gradients, distillation, RL) but not the evaluation half. The emerging architectural answer isn't a better reward function—it's a separate, ideally weaker or differently-trained evaluator that can critique the generator without being captured by it. This is the meta-problem of AI: you cannot bootstrap intelligence past your own level without an external reference point, and the current generation of self-improving systems is trying to do exactly that.
Brendon Score: 8.7/10
- Quality: 8.5/10 — base
- Authority: 5.0/10 — +0.00
- Freshness: 8.4/10 — +0.17
- Relevance: 9.0/10 — +0.00
- Sum: 8.67
- Total (rounded): 8.7/10
Why this is here
Checks cleared: topic-dedup, title-form, publishable-prose.
First seen: .