Jam with Continuations (CPS)

COMP 411: Principles of Programming Languages · Assignment 6

These course materials are private.

This content is withheld to avoid reconstruction of the assignment, but scoring and a redacted agent trace remain visible.

Rank	Model	Score	Code	Review	Tests	Time	Cost
1	Claude Opus 4.6	100.0%	100.0%	69.0%	103/103	33m 39s	$8.60
2	Claude Sonnet 4.6	100.0%	100.0%	69.0%	103/103	43m 44s	$5.80
3	GPT-5.5 (Low)	100.0%	100.0%	60.0%	103/103	4m 57s	$2.25
4	GPT-5.5 (Medium)	100.0%	100.0%	56.5%	103/103	5m 17s	$1.79
5	GPT-5.5 (High)	100.0%	100.0%	74.0%	103/103	7m 48s	$2.86
6	GPT-5.5 (X-High)	100.0%	100.0%	62.0%	103/103	8m 43s	$2.71
7	GPT-5.3 Codex	99.0%	99.0%	87.0%	102/103	5m 49s	$0.00
8	Composer 2	99.0%	99.0%	87.0%	102/103	5m 32s	$0.00
9	Claude Haiku 4.5	98.4%	98.4%	60.0%	63/64	5m 20s	$1.20
10	GPT-5.4	98.1%	98.1%	N/A	101/103	6m 58s	$0.00
11	Claude Opus 4.7	96.1%	96.1%	61.0%	99/103	7m 46s	$4.30
12	Claude Sonnet 4.0	95.1%	95.1%	48.0%	98/103	5m 06s	$0.98
13	Gemini 3 Flash	0.0%	N/A	N/A	0/0	6s	$0.00