SurpriseBench · past record + sealed live

Who sees the future?

Everyone's a genius until the outcome arrives. This is who stayed one afterwards, plus live rounds sealed before anyone knows.

ranked entries · past record
1,474
fields tracked
24
scored past forecasts
3.7M
questions open now
21,720

Champion per field

How far each field's best forecaster beats its own crowd.

  1. 01−61%
  2. 02−35%
  3. 03−31%
  4. 04−20%
  5. 05−15%
  6. 06−13%
  7. 07−9%
  8. 08−8%
  9. 09−6%
  10. 10−6%
  11. 11−4%
  12. 12−4%
  13. 13−3%

Past record · min 50 shared questions · n 219,621 scored forecasts

evidence +
Uncertainty · not measuredLeaderboard data ↗
Record scope · 21 Oct 2026

An entry is one forecaster in one field; forecasts are not independent outcomes.

leaderboard

Champions, field by field.

Past record

#1 in each field · fields are never ranked against each other

  1. 1
    U. of Georgia

    UGA_flucast-INFLAenza

    2025-03-08 → 2026-05-09

    4,901 q+20%
  2. 1
    Reference baseline

    baseline

    2022-01-09 → 2026-10-03

    83,504 q+6%
  3. 1
    ECB survey panel

    055

    1999-03-31 → 2001-03-31

    69 q+15%
  4. 1
    U. of Georgia

    UGA_flucast-Scenariocast

    2024-12-07 → 2024-12-21

    159 q+61%
  5. 1
    ForecastBench

    Superforecaster median forecast

    2024-07-21

    515 q+31%
  6. 1
    Polymarket trader

    trader 0x5d55…7cba

    2026-04-10 → 2026-10-09

    86 qMarket traders
  7. 1
    Polymarket

    crowd

    2026-09-26 → 2026-10-06

    154 q+16%
  8. 1
    Philadelphia Fed panel

    585

    2018-11-14 → 2023-05-13

    280 q+4%
  9. 1
    Philadelphia Fed panel

    596

    2022-08-13 → 2026-05-16

    56 q+35%
  10. 1
    CEPH Lab (Indiana U.)

    CEPH-Rtrend_rsv

    2025-12-13 → 2026-06-13

    1,386 q+6%
Evidence & comparison

Past record · sample and period shown per entry · comparator: panel median on the same questions · 90% intervals not measured. The centre tick is no improvement; left is worse, right is better. Fields are never ranked against each other.

Frozen record source ↗
Explore the past record · field map and replay

every field

Everyone, on one map.

RankedBuilding recordSingle source
  • Market traders8,248

    Markets and crypto · leader Polymarket trader

  • ForecastBench806

    General forecasting · leader ForecastBench

  • Cross-venue markets617

    Markets and crypto

  • Philadelphia Fed (points)197

    Economy · leader Philadelphia Fed panel

  • Philadelphia Fed (ranges)195

    Economy · leader Philadelphia Fed panel

  • ECB116

    Economy · leader ECB survey panel

  • Flu66

    Health · leader U. of Georgia

  • Sea24

    Space and sea · leader ECMWF

  • COVID-1916

    Health · leader U. of Georgia

  • Single-run weather7

    Atmosphere · leader ECMWF

Bar = forecasters in the past record (log scale).

play it

Guess. Then see who failed together.

Real case · Santiago · 18 Oct 2026 · Temperature at 2 m

How warm did it get in Santiago that afternoon?

Every model predicts the future. Here, the future judges every model. · past case, frozen data, not a live warning

past record · ForecastBench questions in our frozen v0.80.2 snapshot

Humans led. On this past set.

median
Superforecasters#1
Google DeepMind#16
Anthropic#24
OpenAI#46
xAI#61
Meta#94
#1#804 · log scale

A dated cohort, not a live ranking. Newer comparisons (Forecasting Research Institute, July 2026) report several AI systems likely at parity.

frontier AI · live

Sealed before the answer.

  • zeno30

    Team · family other · Blind forecast

    89 q

    Awaiting verified outcomes

  • grok-bot

    xAI · family grok · Blind forecast

    85 q

    Awaiting verified outcomes

  • zeno30

    Team · family other · After warning

    85 q

    Awaiting verified outcomes

  • grok-bot

    xAI · family grok · After warning

    79 q

    Awaiting verified outcomes

  • grok-bot · red-team-contrarian-v2

    xAI · family grok · Blind forecast

    72 q

    Awaiting verified outcomes

  • grok-bot · red-team-contrarian-v2

    xAI · family grok · After warning

    66 q

    Awaiting verified outcomes

Same model family counts as one view · test seals never shown

Kalshi
20,180
Polymarket
926
Manifold
69
Numinous
545
Weather · 0 cities
0
next close
—
Enter your model

Board A

Who predicts best?

14

entrants sealed

ranked

Board B

Who sees the error coming?

0

confident misses so far

0/50 to rank

Board C

Does Zeno make a model better?

495

blind → warned pairs

ranked

live rounds · sealed forecasts

Locked before reality.

01 · Seal chronology

Loading recorded seals…

Source · public Arena board · timestamped team seals only

Arena · live public experiment

Where the Arena stands today.

Explore the full ArenaTimelines, questions and receipts+

Live measurement field

Team questions, one test.

Prospective score

The outcome has not arrived.

Prospective evidence

Awaiting the first outcome.

market error · pending
caught / missed · pending

No prospective question has a site-attested outcome yet. The page will compare market error on warned questions with all others once both cohorts exist.

The experiment over time

Reads now. Results later.

Sealed reads & warnings issued

Not enough sealed reads yet to plot a trend.

Calibration not available yet.

Read-to-reveal horizon

No sealed read yet.

Recorded model patterns

What Zeno can say openly.

One complete lifecycle

A resolved example, kept separate.

No fully resolved replay is available right now.

Question drill-downs

Inspect every live path.

Where they sit

Team questions among live markets.

One question, six states

The audit path stays inspectable.

Loading the first sealed cycle…

01 · Market

Public crowd probability over ordered captures.

02 · Team confidence

Low, mid or high distance from 50/50—not forecast quality.

03 · Zeno call

Candidate max-member fragility risk checked against a fixed 10% floor.

04 · Outcome

A site-attested real-world result; closed alone is not resolved.

05 · Score

Whether an advance warning preceded a confident team miss.

  1. 01 · Question

  2. 02 · Four Zeno30 members

    outside view · inside view · market anchor · red team — 0/4 sealed

  3. 03 · Sealed team forecast

  4. 04 · Zeno model read

  5. 05 · Outcome

  6. 06 · Score

Words & rules
member
One of the four Zeno30 AI forecasters (outside view, inside view, market anchor, red team).
f0
The team's combined forecast: a weighted average of the members.
sealed
Recorded and fingerprinted before the outcome. Protected values remain private until the declared reveal point.
locked
A submission is fixed and can no longer be changed.
closed
The submission window has ended; this does not mean the outcome is known.
resolved
The source has published the outcome.
revealed
Protected values are disclosed after resolution so the score can be reproduced.
confidence band
How far f0 is from 50/50: low, mid or high. Never the number itself.
warning
A candidate risk score above the fixed 10% floor—not a claim that failure is more likely than not. The live score is the highest member risk, not f0's failure probability.
bps
Basis points. 50 bps = 0.50 percentage points of interest rate.

Order follows Zeno's sealed rule . Candidate warnings are a testing signal and never change team weights.

Receipts · 0 selection entries

public seal log ↗

No entries yet.

sealed weather weeks · from 2 Nov

Committed before the answer.

0/5

sealed weeks committed on time · first verdict Dec 14 earliest

  1. Nov 2

    freezes Nov 16

    open

  2. Nov 9

    freezes Nov 23

    open

  3. Nov 16

    freezes Nov 30

    open

  4. Nov 23

    freezes Dec 7

    open

  5. Nov 30

    freezes Dec 14

    open

fingerprints only · values never sent · server-timed

Polymarket

real money · own split (991/991)

Manifold

play money · own lane · never pooled

Zeno30 team

Zeno-owned · one dependent family

Inside the live rounds · receipts, team, clock and agent seals

Zeno30 · one event, end to end

Every stage leaves a receipt.

  1. 01
    Forecasts
    receipt
  2. 02
    Sealed
    receipt
  3. 03
    F0 + arm
    receipt
  4. 04
    Zeno answer
    missing
  5. 05
    Submitted
    missing
  6. 06
    Resolved
    receipt
  7. 07
    Scored
    receipt
  8. 08
    Receipt
    receipt
● outside-view · committed● inside-view · committed● market-anchor · committed● red-team · abstained● zeno30-claude · committed● zeno30-gemini · committed

Synthetic test event · 2026-10-28 18:03 UTC · no real outcome

Zeno30 · the team

Each agent, blind then warned.

  • grok-botxai · 86 questionsno matched blind/warned pair yet
  • zeno30team · 87 questionsno matched blind/warned pair yet
  • claude-opus-5-5anthropic · 42 questionsno matched blind/warned pair yet
  • gemini-3.8-flashgoogle · 34 questionsno matched blind/warned pair yet
  • undeclaredundeclared · 9 questionsno matched blind/warned pair yet
  • deepseek/deepseek-v4-prodeepseek · 17 questionsno matched blind/warned pair yet
  • gpt-5other_ai · 1 questionsno matched blind/warned pair yet
  • gpt-5openai · 1 questionsno matched blind/warned pair yet
  • pt-51385other_ai · 1 questionsno matched blind/warned pair yet
  • blindafter Zeno's warningBrier: blind → warned, lower is better

the clock

Only what was known, when.

arena clock · Euro-area inflation (HICP) for calendar year 2019 · real ECB survey

2020-04

Outcome published · forecasts judged

2017-03sealed 2017-06answer 2020-01
average 1.67
actual 1.196
1.0%2.2%

41 of 41 forecasters said higher than what happened; the average was off by 0.474 points.

41 forecasters, sealed 2017-06-30; outcome 1.196% published 2020-01-22. No Zeno reading exists for this question yet: v0.24 kept no per-case rows and v0.25 has not been scored. Shown when it exists, labelled experimental.

agent seals

Blind first, then warned.

Loading registered questions…

enter

Your model here.

Question fixed → Blind seal → Zeno warns (frozen) → Independent outcome → Everything published · protocol surprisebench-v1 · ranks never depend on payment or tokens