Statically Typed Jam

COMP 411: Principles of Programming Languages · Assignment 5

These course materials are private.

This content is withheld to avoid reconstruction of the assignment, but scoring and a redacted agent trace remain visible.

Rank	Model	Score	Code	Review	Tests	Time	Cost
1	Claude Sonnet 4.0	100.0%	100.0%	65.0%	27/27	9m 24s	$2.08
2	Claude Opus 4.6	100.0%	100.0%	85.0%	27/27	18m 42s	$3.87
3	Claude Sonnet 4.6	100.0%	100.0%	86.0%	27/27	13m 51s	$2.09
4	Claude Haiku 4.5	100.0%	100.0%	68.0%	27/27	5m 23s	$0.98
5	GPT-5.4	100.0%	100.0%	N/A	27/27	5m 40s	$0.00
6	GPT-5.3 Codex	100.0%	100.0%	80.0%	27/27	7m 03s	$0.00
7	Composer 2	100.0%	100.0%	88.0%	27/27	8m 09s	$0.00
8	GPT-5.5 (Low)	100.0%	100.0%	69.0%	27/27	4m 37s	$1.37
9	GPT-5.5 (Medium)	100.0%	100.0%	77.5%	27/27	4m 42s	$1.23
10	GPT-5.5 (High)	100.0%	100.0%	73.0%	27/27	6m 22s	$1.35
11	GPT-5.5 (X-High)	100.0%	100.0%	68.0%	27/27	10m 33s	$1.84
12	Claude Opus 4.7	100.0%	100.0%	76.5%	27/27	10m 36s	$4.59
13	Gemini 3 Flash	0.0%	N/A	N/A	0/0	5s	$0.00