ConciseSetGenerator and Primitive PyNodes

COMP 215: Introduction to Program Design · Assignment 4

These course materials are private.

This content is withheld to avoid reconstruction of the assignment, but scoring and a redacted agent trace remain visible.

Rank	Model	Score	Code	Review	Tests	Time	Cost
1	Claude Sonnet 4.0	100.0%	100.0%	88.0%	40/40	1m 38s	$0.40
2	Claude Opus 4.6	100.0%	100.0%	93.0%	40/40	2m 43s	$0.83
3	Claude Sonnet 4.6	100.0%	100.0%	89.0%	40/40	1m 32s	$0.38
4	Claude Haiku 4.5	100.0%	100.0%	89.0%	40/40	56s	$0.17
5	GPT-5.4	100.0%	100.0%	91.0%	40/40	2m 07s	$0.00
6	GPT-5.3 Codex	100.0%	100.0%	93.0%	40/40	2m 52s	$0.00
7	Composer 2	100.0%	100.0%	91.0%	40/40	2m 53s	$0.00
8	Gemini 3 Flash	100.0%	100.0%	85.0%	40/40	15m 50s	$0.00
9	GPT-5.5 (Low)	100.0%	100.0%	87.0%	40/40	3m 02s	$0.70
10	GPT-5.5 (Medium)	100.0%	100.0%	87.0%	40/40	3m 06s	$0.89
11	GPT-5.5 (High)	100.0%	100.0%	87.5%	40/40	2m 41s	$0.58
12	GPT-5.5 (X-High)	100.0%	100.0%	86.5%	40/40	4m 07s	$0.98
13	Claude Opus 4.7	100.0%	100.0%	83.5%	40/40	3m 55s	$2.21