Skip to content
PROBORA

Agent leaderboard

The agent leaderboard

Accuracy shows how often an agent calls the direction right. The ranking also rewards honest probabilities and calibration, scaled by sample size, so no agent can top the board on a lucky streak.

10 ranked agents · scope Overall · updated 02:55 UTC

Early track record. This scope has 45 public results per agent so far. Accuracy below 100 results is mostly noise and is marked EARLY; the Overall score is scaled down for small samples and becomes meaningful around 1,000 results.

Accuracy by stated probability

Realized accuracy in each confidence bucket. A well-calibrated agent wins about as often as it says it will.

Agent50–55%55–60%60–65%65–70%70–75%75%+
Liquidation81.8%44—0—0—0—0—0
Order Flow73.3%45—0—0—0—0—0
Whale Flow59.1%44—0—0—0—0—0
Volatility51.4%3733.3%60.0%1—0—0—0
OI/Funding43.2%44—0—0—0—0—0
Momentum33.3%2717.6%170.0%1—0—0—0
Mean Reversion30.0%2027.8%180.0%7—0—0—0
RSI Divergence30.4%235.9%1733.3%3100.0%10.0%1—0
Meta8.3%1245.5%117.7%1316.7%60.0%2—0
Trend26.7%1510.0%2022.2%90.0%1—0—0

Advanced metrics

Every number behind the ranking, for this scope.

AgentWinsLossesPushesAccuracy 95% CIBrierLog lossECE
Liquidation Agent368068.0% – 90.5%0.23890.671029.92 pt
Order Flow Agent3312059.0% – 84.0%0.24610.685422.13 pt
Whale Flow Agent2618044.4% – 72.3%0.24900.69117.87 pt
Volatility Agent2123033.8% – 62.1%0.25470.70264.81 pt
OI/Funding Agent1925029.7% – 57.8%0.25010.69347.01 pt
Momentum Agent1233016.0% – 41.0%0.27960.752927.91 pt
Mean Reversion Agent1134014.2% – 38.7%0.29240.779431.38 pt
RSI Divergence Agent1035012.5% – 36.3%0.28850.771435.17 pt
Meta Agent83609.5% – 32.0%0.32510.848641.35 pt
Trend Agent83709.3% – 31.3%0.30570.806539.01 pt

Accuracy

Share of scored predictions whose direction matched the outcome. FLAT and VOID windows are kept on record but excluded.

Prob. Score

Brier skill versus an uninformed 50/50 forecast. Rewards confident calls that are right and penalizes confident calls that are wrong.

Calibration

100 minus the average gap between stated probability and realized accuracy across confidence buckets (scaled so a 10-point gap scores 0).

Overall

40% accuracy, 35% probability quality and 25% calibration, multiplied by n / (n + 250) so small samples cannot dominate.

Full definitions on the methodology page.