GovernanceTechnicalA few weeksAdvancedFree

Could distributed training dodge compute limits?

New methods let models train across many loosely connected computers. Use Epoch AI’s simulator and recent papers to analyse whether this undermines governance based on big data centres.

Download PDFDataReading & writing

Why it matters

If training can be spread out, verification that looks for big clusters may fail. Policymakers need a clear-eyed estimate.

Output: An analysis with simulator results.

Getting started

0 of 5 done
  1. Write your question in one sentence.

  2. Spend 30 minutes finding what has already been written about it.

  3. Collect evidence in a simple table: claim, source, how strong.

  4. Draft 1–2 pages: answer first, then reasons, then uncertainties.

  5. Ask one person to poke holes in it, revise, and share.

Related projects

Governance1–3 hoursGuided

Estimate how much compute a famous model needed

Use the rule of thumb “training compute ≈ 6 × parameters × training tokens” to estimate the compute behind a model, then compare your answer with Epoch AI’s database.

DataView project
GovernanceA few weeksAdvanced

How much compute did the key AI innovations need?

Could algorithmic progress continue under a compute halt? Catalogue the innovations in a major model paper and estimate the compute used in the experiments behind each, extending published MIRI TGT work.

DataView project
GovernanceA weekendGuided

Spot an AI data centre from space

Pick a known AI cluster from Epoch AI’s GPU cluster data, find it in free satellite imagery and document how it has grown over time.

DataVisualView project

Further reading

Related mentored projects