FCSFrontierCS 2 · CourseAbout this course ← All lectures Benchmark ↗
About

How this course is made

Designed by Boxi Yu

FrontierCS 2 asks AI agents to do computer-science research: each task removes the key idea of a paper from the authors' own code, and an agent must write it back and beat the original. This course teaches those 48 tasks, one field at a time, so that a student can follow what each paper found and what the agents did.

What each lecture covers

For every task in a field, a lecture explains four things, in this order:

01 · THE IDEA

What the paper found

Built up from a small runnable example you can modify in your browser.

02 · REMOVED PART

What the agent writes

The exact contribution cut from the authors' released repository.

03 · EVALUATION

How it is judged

The metrics, hidden workloads, and strict pass rules with their margins.

04 · AGENT RUNS

What the agents did

Who passed, the best scores against the reference, and the ideas behind the best runs.

Lecture 0 explains the benchmark itself: how a task is built, the pass rule, and how the leaderboard is computed.

Where the material comes from

Only public sources: the task statements an agent reads, the papers, and the task pages and case studies on frontier-cs.org. Nothing comes from a task's hidden workloads, its judge, or the authors' reference code, so the lectures do not give away how to pass a task. Small examples and their numbers are ours, and each lecture says so.

How each lecture is checked

Source and contributions

The source of the course (notes, pages and checking tools) is public at github.com/boxi-cs/frontiercs2-src. Corrections are welcome as an issue or a pull request; its CONTRIBUTING.md explains how to preview and check a lecture.

The benchmark

The tasks, results and case studies belong to the FrontierCS 2 benchmark. To run it yourself, see github.com/FrontierCS/FrontierCS-2.