PhilosophyPolicyA few weeksIntermediateFree

How much should people defer to AI?

Lange argues AI outputs should count as one input alongside our own reasons, not replace them. Run a small study: show volunteers AI answers (some reliable, some subtly wrong) and measure how much they update.

Download PDFPeopleDataReading & writing

Research with people. Check your university’s ethics requirements first, get informed consent and anonymise any data you share.

Why it matters

As AI becomes everyone’s first source of answers, how much people defer to it shapes collective reasoning.

Output: A comparison of actual deference with Lange’s “total evidence” standard, plus interface design suggestions.

Getting started

0 of 5 done
  1. Write down what you want to learn from people.

  2. If you are studying people, check your university’s ethics process first.

  3. Pilot with 3–5 people and fix what confuses them.

  4. Run it properly and take careful notes.

  5. Share the results (anonymised) and what you would change next time.

Related projects

PhilosophyA few weeksStarter

Run your own collective constitution

In Anthropic and CIP’s study, about 1,000 Americans used the open-source tool Polis to write a constitution for an AI. Run the same process with 30–100 students and compare your result with theirs.

PeopleReading & writingView project
PolicyA few weeksIntermediate

Build an AI tool that helps people make better decisions

AI could make institutions better or worse at reasoning and coordinating. Prototype one tool or evaluation from BlueDot’s decision-making hackathon or Forethought’s design sketches.

CodeVisualView project
PhilosophyA few weeksIntermediate

Does interpretability answer the octopus test?

Bender and Koller argue a system trained only on text cannot learn meaning. Use Neuronpedia’s free interface to Gemma Scope to inspect features for concepts that seem to need grounding (colours, spatial relations) and check whether they respond across very different wordings.

Chatbot experimentsReading & writingView project

Further reading

Related mentored projects