Three Interpreters (CBV/CBN/CBNeed)

COMP 411: Principles of Programming Languages · Assignment 2

These course materials are private.

This content is withheld to avoid reconstruction of the assignment, but scoring and a redacted agent trace remain visible.

Rank	Model	Score	Code	Review	Tests	Time	Cost
1	Claude Sonnet 4.0	100.0%	100.0%	83.0%	39/39	6m 37s	$1.67
2	Claude Opus 4.6	100.0%	100.0%	91.0%	39/39	8m 15s	$1.93
3	Claude Sonnet 4.6	100.0%	100.0%	92.0%	39/39	7m 09s	$0.84
4	Claude Haiku 4.5	100.0%	100.0%	76.0%	39/39	2m 31s	$0.44
5	GPT-5.4	100.0%	100.0%	N/A	39/39	2m 46s	$0.00
6	GPT-5.3 Codex	100.0%	100.0%	95.0%	39/39	3m 03s	$0.00
7	Composer 2	100.0%	100.0%	90.0%	39/39	3m 50s	$0.00
8	Gemini 3 Flash	100.0%	100.0%	83.0%	39/39	16m 32s	$0.00
9	GPT-5.5 (Low)	100.0%	100.0%	81.0%	39/39	3m 08s	$1.10
10	GPT-5.5 (Medium)	100.0%	100.0%	87.0%	39/39	3m 43s	$1.02
11	GPT-5.5 (High)	100.0%	100.0%	83.5%	39/39	4m 46s	$1.24
12	GPT-5.5 (X-High)	100.0%	100.0%	81.5%	39/39	5m 47s	$1.32
13	Claude Opus 4.7	100.0%	100.0%	87.0%	39/39	6m 18s	$2.97