science

Metaculus

Metaculus is a science topic covered in the lgStudy science library. This page brings together a partial reference excerpt, illustrations, worked examples, real-world applications and a short study plan, so you can understand Metaculus rather than just read about it. In short: Metaculus is an American reputation-based, massive online prediction solicitation and aggregation engine. One of the focuses of Metaculus is predicting the timing, nature and impact of scientific and technological advances and breakthroughs.

Key takeaways

Metaculus belongs to science; place it in that map before memorising details.
Learn the definition first, then one example that makes the definition concrete.
Connect Metaculus to a quantity you can measure, compute or draw — that is where exam questions come from.
Reproduce the core statement of Metaculus from memory before moving on to harder problems.

Reference excerpt

Metaculus is an American reputation-based, massive online prediction solicitation and aggregation engine. One of the focuses of Metaculus is predicting the timing, nature and impact of scientific and technological advances and breakthroughs.

Reward system Three types of predictions can be made: probability predictions to binary questions that resolve as either 'yes' or 'no', numerical-range predictions, and date-range predictions. Users can contribute to the community prediction for any given question, leave comments and discuss prediction strategies with other users. Users can suggest new questions which, after moderation, will be opened to the community. Users can earn points for successful predictions (or lose points for unsuccessful predictions), and track their own predictive progress. The scoring awards points both for being right and for being more right than the community. In January 2020, Metaculus introduced the Bentham Prize, which awards bi-weekly monetary prizes of $300, $200 and $100 to the first, second and third most valuable user contributions. The following month, Metaculus introduced the Li Wenliang prize, which awards a number of different monetary prizes to questions, forecasts and analyses related to the COVID-19 outbreak.

History Data scientist Max Wainwright and physicists Greg Laughlin and Anthony Aguirre launched the site in 2015. In June 2017, the Metaculus Prediction was launched, which is a system for aggregating user predictions. The Metaculus Prediction, on average, outperforms the median of the community's predictions when evaluated using the Brier or Log scoring rules. In 2021, Metaculus received an Effective altruism infrastructure fund grant worth $300k. In 2022, Metaculus received a $5.5m grant from Open Philanthropy. In October 2022, Metaculus received $20k funding from the FTX future fund, 3 weeks before the bankruptcy of FTX. In 2022 the organization announced it reached 1,000,000 individual predictions, and that it was restructured as a public-benefit corporation, it is committed to the following goals, its new charter compels it to report annually on its progress in achieving these goals:

Fostering the growth, learning, and development of the forecasting and forecasting research communities. Supporting stakeholders who are serving the public good by informing their decision making. Increasing public access to information regarding forecasts of public interest. In 2024, Metaculus rewrote their website code and released it under the BSD-2-Clause License.

See also Superforecasting: The Art and Science of Prediction Iowa Electronic Markets PredictIt Prediction market Futarchy

References

External links Metaculus website

Worked examples

Example 1 — a first encounter with Metaculus

Start with the simplest possible case. Write down what Metaculus claims or describes in one sentence, then invent the smallest concrete situation in which that sentence is true. In science, the smallest case is usually a single object, a single equation or a single measurement. Check that every symbol or term in your sentence has a meaning in that case.

Example 2 — changing one variable

Take the situation from Example 1 and change exactly one quantity: double it, halve it, or set it to zero. Predict what should happen to Metaculus before you calculate. Comparing your prediction with the result is the fastest way to find out whether you understand the idea or only the words.

Example 3 — an exam-style question

Typical questions about Metaculus ask you to (a) state it precisely, (b) apply it to given data, and (c) explain a limitation. Practise writing all three answers in under five minutes; the third part is what separates a full-mark answer from an average one.

Applications of Metaculus

In research: Metaculus appears in science research whenever the underlying quantities have to be modelled precisely. Papers usually cite it as a starting assumption and then explore where it breaks down.
In technology and industry: Engineering practice reuses Metaculus in design rules, simulations and safety margins. Knowing the idea lets you read a specification sheet and understand why the numbers look the way they do.
In the classroom: Metaculus is common in secondary-school and first-year university syllabi. It links to neighbouring topics Organizations associated with effective altruism, Prediction markets, Predictive analytics, so understanding it makes those chapters shorter.
In everyday life: Look for Metaculus outside the textbook — in sport, cooking, traffic, electronics or the sky above you. An example you found yourself is remembered far longer than one you were given.

Affiliate

Preply — study more efficiently by working with a personal tutor. 50% off.

How to study Metaculus in 20 minutes

Read the reference excerpt below once, without taking notes.
Close the page and write down what Metaculus means in your own words.
Compare your version with the excerpt and mark what you missed.
Work through the three examples above with pen and paper.
Explain Metaculus out loud to somebody else — or to Teacher Smith in the lgStudy chat.

Frequently asked questions

What is Metaculus in simple terms?

Why does Metaculus matter?

Because it connects several science ideas at once: it gives you a definition you can apply, a quantity you can calculate, and a way to check whether a result is plausible.

How should I study Metaculus?

Read the excerpt, restate it from memory, then work through the examples and applications listed on this page. The five-step study plan above takes about twenty minutes.

What does this page cover?

It gives you a compact reference excerpt plus original lgStudy explanations, examples, applications and study material on Metaculus.