Outcome Distribution by Setting
DSPy
gpt5.1
gpt5.1 outcome distribution per setting on DSPy.
gpt5.4 mini
gpt5.4 mini outcome distribution per setting on DSPy.
OpenClaw
gpt5.1
gpt5.1 outcome distribution per setting on OpenClaw.
gpt5.4 mini
gpt5.4 mini outcome distribution per setting on OpenClaw.
failure no code invalid core miss success partial perfect
Figure 9. Outcome distribution of GPT-model attempts across the four inference settings.