extraction-qa-invoice

Criteria

keytypeprimitivetier
valid_extraction_shapemust_havejson_schema@1
invoice_number_formatmust_haveregex_match@1
total_is_positivemust_havenumeric_threshold@1
matches_source_documentscoredllm_judge@12

extraction-qa-invoice

**Judges:** structured data extracted from an invoice — schema-valid, well-formed identifiers, positive totals (all deterministic), and field-level fidelity to the source document (judged against references). **Use when:** an LLM/OCR pipeline extracts financial documents and silent transcription errors cost real money (AP automation, expense ingestion, billing reconciliation).

curl -s -X POST $API/v1/rubrics -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d @templates/extraction-qa-invoice/rubric.json
curl -s -X POST $API/v1/verify -H "Authorization: Bearer $KEY" -H "Content-Type: application/json" \
  -d '{"rubric_id":"<id>","submission":{"inline":"{\"invoice_number\":\"INV-48213\",...}"},"options":{"wait_ms":45000}}'

MCP: `verify_submit` with the extraction JSON as `submission.inline`; supply the source document text as references so `matches_source_document` has ground truth.