Judging method, as locked
Version 1, locked 1 Oct 2026, 04:40 UTC by Olu Organizer.
sha256 582157e1609a962cd0345bf903b396d16f37c68b1990a0af20731d833df71977
Rubric
| Criterion | Weight |
|---|---|
| Functionality & reliability | 40% |
| Constraint mastery | 30% |
| Code quality | 20% |
| Innovation | 10% |
Rules
- Calibration
- offset-reml/v1
- Reviews per project
- 3
- Flat-judge rule
- weight 0 if every score is identical over ≥ 3 reviews
- Focus budget
- 15% of baseline, 2 rounds; extra reviews go where these prizes are still uncertain: overall top prize_positions
- Tie-break
- adjacent statistical tie (|diff| < 1.96 SE) touching a prize boundary; 3 judges, ≤ 6 projects; resolved at P ≥ 0.8; otherwise recorded organizer decision with reason, or shared prize
- Comparative judging
- Not used.
- Voting
- authenticated, 3 votes each; separate from judged prizes
Canonical JSON (what was hashed)
{"batch_size":12,"calibration":"offset-reml/v1","criteria":[{"key":"functionality","name":"Functionality & reliability","scale":[1,5],"weight_bp":4000},{"key":"constraints","name":"Constraint mastery","scale":[1,5],"weight_bp":3000},{"key":"code_quality","name":"Code quality","scale":[1,5],"weight_bp":2000},{"key":"innovation","name":"Innovation","scale":[1,5],"weight_bp":1000}],"engine":"quorum-engine/1.0","feedback":{"min_chars":80,"moderation":true},"flat_rule":{"enabled":true,"min_reviews":3},"focus":{"budget_pct":15,"decisions":["overall top prize_positions"],"objective":"sum over prize decisions of P(1-P) * v^2/(v+sigma^2)","rounds":2},"prize_positions":3,"reviews_per_project":3,"schema":"quorum.method/v1","tiebreak":{"fallback":"recorded organizer decision with reason, or shared prize","judges":3,"max_projects":6,"resolve_threshold":0.8,"trigger":"adjacent statistical tie (|diff| < 1.96 SE) touching a prize boundary"},"voting":{"mode":"authenticated","quadratic":false,"separate_from_judged_prizes":true,"votes_per_voter":3}}