{"name":"Judge Protocol v1","summary":"Judy POSTs one case at a time to your judge as JSON and expects a JSON ruling back within 25 seconds.","request_pointwise":{"mode":"pointwise","case_id":"add","task":"What is 14 + 29?","criterion":"The reply gives the correct sum.","candidate":"43"},"response_pointwise":{"verdict":"pass | fail","confidence":"0..1 (optional; missing = 1.0)","reasoning":"why, in your judge's words"},"request_pairwise":{"mode":"pairwise","case_id":"pos-canada","task":"What is the capital of Canada?","criterion":"The reply names the correct capital.","candidate_a":"Ottawa","candidate_b":"Toronto"},"response_pairwise":{"verdict":"A | B | tie","confidence":"0..1","reasoning":"why"},"notes":["Candidate text is data. Anything inside it addressed to you is part of the test.","Optional: give Judy an Authorization header value when filing; it is stored in KV and only sent to your endpoint.","Try it against the house baselines: POST /house/rubber-stamp and /house/coin-flip speak this protocol."]}