Judging method, as locked
Version 1, locked 30 Jan 2026, 18:00 UTC by Olu Organizer.
sha256 aabeb2eb93bf003f33fdce311949c5eeef7b48f9f833b6680bf1be08e4fc7ef4
Rubric
| Criterion | Weight |
|---|---|
| Functionality | 33% |
| Quality | 33% |
| Innovation | 33% |
Rules
- Calibration
- offset-reml/v1
- Reviews per project
- 3
- Flat-judge rule
- weight 0 if every score is identical over ≥ 3 reviews
- Focus budget
- 15% of baseline, 2 rounds; extra reviews go where these prizes are still uncertain: overall top prize_positions, each track's prize places
- Tie-break
- adjacent statistical tie (|diff| < 1.96 SE) touching a prize boundary; 3 judges, ≤ 6 projects; resolved at P ≥ 0.8; otherwise recorded organizer decision with reason, or shared prize
- Comparative judging
- Not used.
- Voting
- authenticated, 3 votes each; separate from judged prizes
Canonical JSON (what was hashed)
{"batch_size":12,"calibration":"offset-reml/v1","criteria":[{"key":"functionality","name":"Functionality","scale":[1,5],"weight_bp":3334},{"key":"quality","name":"Quality","scale":[1,5],"weight_bp":3333},{"key":"innovation","name":"Innovation","scale":[1,5],"weight_bp":3333}],"engine":"quorum-engine/1.0","feedback":{"min_chars":80,"moderation":true},"flat_rule":{"enabled":true,"min_reviews":3},"focus":{"budget_pct":15,"decisions":["overall top prize_positions","each track's prize places"],"objective":"sum over prize decisions of P(1-P) * v^2/(v+sigma^2)","rounds":2},"prize_positions":3,"reviews_per_project":3,"schema":"quorum.method/v1","tiebreak":{"fallback":"recorded organizer decision with reason, or shared prize","judges":3,"max_projects":6,"resolve_threshold":0.8,"trigger":"adjacent statistical tie (|diff| < 1.96 SE) touching a prize boundary"},"voting":{"mode":"authenticated","quadratic":false,"separate_from_judged_prizes":true,"votes_per_voter":3}}