Parsing and Abstract Syntax

COMP 411: Principles of Programming Languages · Assignment 1

These course materials are private.

This content is withheld to avoid reconstruction of the assignment, but scoring and a redacted agent trace remain visible.

Rank	Model	Score	Code	Review	Tests	Time	Cost
1	Claude Sonnet 4.0	100.0%	100.0%	86.0%	5/5	4m 47s	$0.93
2	Claude Opus 4.6	100.0%	100.0%	91.0%	5/5	6m 17s	$1.72
3	Claude Sonnet 4.6	100.0%	100.0%	89.0%	5/5	6m 49s	$0.97
4	Claude Haiku 4.5	100.0%	100.0%	83.0%	5/5	3m 17s	$0.43
5	GPT-5.4	100.0%	100.0%	N/A	5/5	1m 48s	$0.00
6	GPT-5.3 Codex	100.0%	100.0%	89.0%	5/5	1m 39s	$0.00
7	Composer 2	100.0%	100.0%	92.0%	5/5	4m 03s	$0.00
8	Gemini 3 Flash	100.0%	100.0%	84.0%	5/5	36m 55s	$0.00
9	GPT-5.5 (Low)	100.0%	100.0%	84.5%	5/5	2m 20s	$0.83
10	GPT-5.5 (Medium)	100.0%	100.0%	87.5%	5/5	2m 25s	$0.64
11	GPT-5.5 (High)	100.0%	100.0%	86.0%	5/5	2m 38s	$0.63
12	GPT-5.5 (X-High)	100.0%	100.0%	83.0%	5/5	4m 41s	$0.85
13	Claude Opus 4.7	100.0%	100.0%	87.0%	5/5	5m 05s	$2.29