RAGvidence comparison / techniques

FROZEN INPUTS / COMPARISON

Technique comparison

docs

complete · reviewed comparison · Phase: dev

Baseline: bm25 · Policy: fixed_k

Keeping the baseline is valid. Choose using these cases and your requirements.

Equal k does not imply equal context volume; resources are reported separately.

Intervals pair questions or families. Repeated timings are not extra samples.

These observations do not prove what caused a particular failure.

Execution & resource trade-offs

Read completion status alongside quality and resource evidence. Timing covers known values only; N/A means unavailable. No automatic winner is selected.

Recorded participant measurements
Participant / statusEvidence scopeQuery time, msRendered contextSupplied-usage cost
bm25
complete
exact returned spans0.80
4 known · 0 missing
161.25 charactersN/A
parent-child
complete
exact returned spans0.17
4 known · 0 missing
741.0 charactersN/A
compress
complete
exact returned spans0.45
4 known · 0 missing
199.5 charactersN/A

parent-child versus bm25

Observed gains/losses under the declared policy; no automatic winner

Scope: exact_returned_spans

dev / all

4 answerable questions · Improved 1 · Regressed 0 · Stable pass 3 · Stable fail 0

Paired metric differences and 95% intervals · dev / all
Paired changeMean difference95% intervalDeclared groups
sufficiency_rate0.250.0 to 0.75
Small samples and reused public heldout data limit inference
4
mean_evidence_coverage0.1250.0 to 0.375
Small samples and reused public heldout data limit inference
4
mean_reciprocal_rank0.00.0 to 0.0
Small samples and reused public heldout data limit inference
4
mean_precision_at_k0.00.0 to 0.0
Small samples and reused public heldout data limit inference
4

heldout / all

0 answerable questions · Improved 0 · Regressed 0 · Stable pass 0 · Stable fail 0

Paired metric differences and 95% intervals · heldout / all
Paired changeMean difference95% intervalDeclared groups
sufficiency_rateN/AN/A to N/A
No interval: fewer than two independent declared groups
0
mean_evidence_coverageN/AN/A to N/A
No interval: fewer than two independent declared groups
0
mean_reciprocal_rankN/AN/A to N/A
No interval: fewer than two independent declared groups
0
mean_precision_at_kN/AN/A to N/A
No interval: fewer than two independent declared groups
0
Question-level changes
Question / splitOutcomeGained evidenceLost evidenceStill missing
Q1 · devimprovedPOWERnonenone
Q2 · devstable passnonenonenone
Q3 · devstable passnonenonenone
Q4 · devstable passnonenonenone

compress versus bm25

Observed gains/losses under the declared policy; no automatic winner

Scope: exact_returned_spans

dev / all

4 answerable questions · Improved 0 · Regressed 0 · Stable pass 3 · Stable fail 1

Paired metric differences and 95% intervals · dev / all
Paired changeMean difference95% intervalDeclared groups
sufficiency_rate0.00.0 to 0.0
Small samples and reused public heldout data limit inference
4
mean_evidence_coverage0.00.0 to 0.0
Small samples and reused public heldout data limit inference
4
mean_reciprocal_rank0.00.0 to 0.0
Small samples and reused public heldout data limit inference
4
mean_precision_at_k0.00.0 to 0.0
Small samples and reused public heldout data limit inference
4

heldout / all

0 answerable questions · Improved 0 · Regressed 0 · Stable pass 0 · Stable fail 0

Paired metric differences and 95% intervals · heldout / all
Paired changeMean difference95% intervalDeclared groups
sufficiency_rateN/AN/A to N/A
No interval: fewer than two independent declared groups
0
mean_evidence_coverageN/AN/A to N/A
No interval: fewer than two independent declared groups
0
mean_reciprocal_rankN/AN/A to N/A
No interval: fewer than two independent declared groups
0
mean_precision_at_kN/AN/A to N/A
No interval: fewer than two independent declared groups
0
Question-level changes
Question / splitOutcomeGained evidenceLost evidenceStill missing
Q1 · devstable failnonenonePOWER
Q2 · devstable passnonenonenone
Q3 · devstable passnonenonenone
Q4 · devstable passnonenonenone

bm25

Status: complete

Strategy: bm25 · k=1 · 10 prepared passages

Evidence scope: exact_returned_spans

Reviewed evidence is scored against the union of exact original-text spans.

Split / sliceSufficient / answerableCoverageMRRPrecision
dev / all3 / 40.8751.01.0
heldout / all0 / 0N/AN/AN/A

Mean query time over 4 known values: 0.80 ms · 0 missing

Mean rendered context: 161.25 characters · Original text characters: 97.0

Supplied-usage cost estimate: N/A · Pricing: unavailable

Configuration, criteria and separate timing trials
{
  "config": {
    "candidate_k": 1,
    "child_overlap": 50,
    "child_size": 500,
    "child_splitter": "none",
    "k": 1,
    "lexical_weight": 0.5,
    "model": null,
    "name": "bm25",
    "provider": null,
    "query_variants": {},
    "representation": "body",
    "reranker_model": null,
    "rrf_constant": 60,
    "strategy": "bm25"
  },
  "criteria": {
    "dev": {
      "checks": [],
      "status": "not_requested"
    },
    "heldout": {
      "checks": [],
      "status": "not_requested"
    }
  },
  "repeat_rankings_changed": false,
  "trials": [
    {
      "artifact_directory": "jobs/bm25/trial-0/attempt-20261019T152651-07023b19cdc5",
      "resources": {
        "context_characters": {
          "known_count": 4,
          "mean_known": 97.0,
          "missing_count": 0
        },
        "context_unit": "characters",
        "context_units": {
          "known_count": 4,
          "mean_known": 161.25,
          "missing_count": 0
        },
        "index_ms": 77.14363600098295,
        "model_cache": "unknown",
        "query_ms": {
          "known_count": 4,
          "mean_known": 0.8010242509044474,
          "missing_count": 0
        },
        "runtime_versions": {
          "bm25s": "0.2.14",
          "numpy": "2.5.4"
        },
        "vector_cache": "not_applicable"
      },
      "reused": false,
      "trial": 0
    }
  ]
}
Ranked contexts and stage evidence (4 questions)
Q1 · How long should I hold the reset button, and what power is required?Fail · Insufficient evidence93 returned text characters

How long should I hold the reset button, and what power is required?

Q1 · 93 returned text characters

Fail · Insufficient evidence · Split: dev · Missing: POWER

Rank 1 · manual.md · Source text · Original characters 23–116

## Reset pairing

Hold the reset button for eight seconds to clear pairing. The status light 
Observed stages and scores
[
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 1,
      "model_cache": "unknown",
      "query": "How long should I hold the reset button, and what power is required?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 1.016311001876602,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light ",
        "rank": 1,
        "score": 2.2885582447052,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 160,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.050705999456113204,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light ",
        "rank": 1,
        "score": 2.2885582447052,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      }
    ],
    "name": "context_selection"
  }
]
Q2 · How long is the warranty and what damage is excluded?Pass · Sufficient evidence99 returned text characters

How long is the warranty and what damage is excluded?

Q2 · 99 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · manual.md · Source text · Original characters 227–326

## Warranty

The warranty lasts two years. Keep your receipt. Accidental water damage is excluded. 
Observed stages and scores
[
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 1,
      "model_cache": "unknown",
      "query": "How long is the warranty and what damage is excluded?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.09969899838324636,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Warranty\n\nThe warranty lasts two years. Keep your receipt. Accidental water damage is excluded. ",
        "rank": 1,
        "score": 3.4753642082214355,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 161,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.028574999305419624,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Warranty\n\nThe warranty lasts two years. Keep your receipt. Accidental water damage is excluded. ",
        "rank": 1,
        "score": 3.4753642082214355,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      }
    ],
    "name": "context_selection"
  }
]
Q3 · How often should I charge an unused device?Pass · Sufficient evidence98 returned text characters

How often should I charge an unused device?

Q3 · 98 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · manual.md · Source text · Original characters 379–477

## Battery care

Store the device in a cool, dry place. Charge it every three months when unused. 
Observed stages and scores
[
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 1,
      "model_cache": "unknown",
      "query": "How often should I charge an unused device?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.06612499782931991,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Battery care\n\nStore the device in a cool, dry place. Charge it every three months when unused. ",
        "rank": 1,
        "score": 1.5058517456054688,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 164,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.026300000172341242,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Battery care\n\nStore the device in a cool, dry place. Charge it every three months when unused. ",
        "rank": 1,
        "score": 1.5058517456054688,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      }
    ],
    "name": "context_selection"
  }
]
Q4 · Where is tracked delivery available?Pass · Sufficient evidence98 returned text characters

Where is tracked delivery available?

Q4 · 98 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · manual.md · Source text · Original characters 564–662

## Delivery

Standard delivery takes five working days. Tracked delivery is available in Morocco. 
Observed stages and scores
[
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 1,
      "model_cache": "unknown",
      "query": "Where is tracked delivery available?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.05724900256609544,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Delivery\n\nStandard delivery takes five working days. Tracked delivery is available in Morocco. ",
        "rank": 1,
        "score": 3.3280820846557617,
        "source_unit_id": "passage-1518103967d65de40d95"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 160,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.02544800008763559,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Delivery\n\nStandard delivery takes five working days. Tracked delivery is available in Morocco. ",
        "rank": 1,
        "score": 3.3280820846557617,
        "source_unit_id": "passage-1518103967d65de40d95"
      }
    ],
    "name": "context_selection"
  }
]

parent-child

Status: complete

Strategy: bm25 · k=1 · 10 prepared passages

Evidence scope: exact_returned_spans

Reviewed evidence is scored against the union of exact original-text spans.

Child retrieval returns full parent source units. Evidence metrics describe parent context; they do not establish that the matching child contains every fact. Child candidate limits can return fewer than k unique parents.

Split / sliceSufficient / answerableCoverageMRRPrecision
dev / all4 / 41.01.01.0
heldout / all0 / 0N/AN/AN/A

Mean query time over 4 known values: 0.17 ms · 0 missing

Mean rendered context: 741.0 characters · Original text characters: 713.0

Supplied-usage cost estimate: N/A · Pricing: unavailable

Configuration, criteria and separate timing trials
{
  "config": {
    "candidate_k": 20,
    "child_overlap": 10,
    "child_size": 100,
    "child_splitter": "recursive",
    "k": 1,
    "lexical_weight": 0.5,
    "model": null,
    "name": "parent-child",
    "provider": null,
    "query_variants": {},
    "representation": "body",
    "reranker_model": null,
    "rrf_constant": 60,
    "strategy": "bm25"
  },
  "criteria": {
    "dev": {
      "checks": [],
      "status": "not_requested"
    },
    "heldout": {
      "checks": [],
      "status": "not_requested"
    }
  },
  "repeat_rankings_changed": false,
  "trials": [
    {
      "artifact_directory": "jobs/parent-child/trial-0/attempt-20261019T152652-c6c2bd1fda1c",
      "resources": {
        "context_characters": {
          "known_count": 4,
          "mean_known": 713.0,
          "missing_count": 0
        },
        "context_unit": "characters",
        "context_units": {
          "known_count": 4,
          "mean_known": 741.0,
          "missing_count": 0
        },
        "index_ms": 0.9598130018275697,
        "model_cache": "unknown",
        "query_ms": {
          "known_count": 4,
          "mean_known": 0.16565724945394322,
          "missing_count": 0
        },
        "runtime_versions": {
          "bm25s": "0.2.14",
          "numpy": "2.5.4"
        },
        "vector_cache": "not_applicable"
      },
      "reused": false,
      "trial": 0
    }
  ]
}
Ranked contexts and stage evidence (4 questions)
Q1 · How long should I hold the reset button, and what power is required?Pass · Sufficient evidence713 returned text characters

How long should I hold the reset button, and what power is required?

Q1 · 713 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · manual.md · Source text · Original characters 0–713

# Orion device manual

## Reset pairing

Hold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.

## Warranty

The warranty lasts two years. Keep your receipt. Accidental water damage is excluded. Contact the support team before returning a device.

## Battery care

Store the device in a cool, dry place. Charge it every three months when unused. Use only the supplied USB-C cable. Recycle batteries at an approved collection point.

## Delivery

Standard delivery takes five working days. Tracked delivery is available in Morocco. Keep the tracking number until the parcel arrives.
Observed stages and scores
[
  {
    "details": {
      "limit": 20,
      "locations": [
        {
          "child_id": "child-0",
          "end": 99,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 0
        },
        {
          "child_id": "child-2",
          "end": 275,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 178
        },
        {
          "child_id": "child-7",
          "end": 704,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 610
        },
        {
          "child_id": "child-3",
          "end": 358,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 265
        },
        {
          "child_id": "child-1",
          "end": 188,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 89
        },
        {
          "child_id": "child-5",
          "end": 533,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 435
        },
        {
          "child_id": "child-4",
          "end": 445,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 348
        },
        {
          "child_id": "child-6",
          "end": 620,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 523
        },
        {
          "child_id": "child-8",
          "end": 713,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 694
        }
      ],
      "query": "How long should I hold the reset button, and what power is required?"
    },
    "elapsed_ms": 0.11351600187481381,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. ",
        "rank": 1,
        "score": 2.315727949142456,
        "source_unit_id": "child-0"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "eep USB-C power connected throughout the reset.\n\n## Warranty\n\nThe warranty lasts two years. Keep ",
        "rank": 2,
        "score": 1.4516243934631348,
        "source_unit_id": "child-2"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "ing days. Tracked delivery is available in Morocco. Keep the tracking number until the parcel ",
        "rank": 3,
        "score": 0.6855702996253967,
        "source_unit_id": "child-7"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "ars. Keep your receipt. Accidental water damage is excluded. Contact the support team before ",
        "rank": 4,
        "score": 0.6573668718338013,
        "source_unit_id": "child-3"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C ",
        "rank": 5,
        "score": 0.16223493218421936,
        "source_unit_id": "child-1"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Charge it every three months when unused. Use only the supplied USB-C cable. Recycle batteries at ",
        "rank": 6,
        "score": 0.10600543022155762,
        "source_unit_id": "child-5"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "am before returning a device.\n\n## Battery care\n\nStore the device in a cool, dry place. Charge it ",
        "rank": 7,
        "score": 0.10283465683460236,
        "source_unit_id": "child-4"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "teries at an approved collection point.\n\n## Delivery\n\nStandard delivery takes five working days. ",
        "rank": 8,
        "score": 0.0,
        "source_unit_id": "child-6"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "he parcel arrives.\n",
        "rank": 9,
        "score": 0.0,
        "source_unit_id": "child-8"
      }
    ],
    "name": "children"
  },
  {
    "details": {
      "query": "How long should I hold the reset button, and what power is required?"
    },
    "elapsed_ms": 0.008194998372346163,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 99,
          "matched_child_id": "child-0",
          "matched_child_start": 0,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.315727949142456,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "parent_expansion"
  },
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 1,
      "model_cache": "unknown",
      "query": "How long should I hold the reset button, and what power is required?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.14025600103195757,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 99,
          "matched_child_id": "child-0",
          "matched_child_start": 0,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.315727949142456,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 741,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.03715999991982244,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 99,
          "matched_child_id": "child-0",
          "matched_child_start": 0,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.315727949142456,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "context_selection"
  }
]
Q2 · How long is the warranty and what damage is excluded?Pass · Sufficient evidence713 returned text characters

How long is the warranty and what damage is excluded?

Q2 · 713 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · manual.md · Source text · Original characters 0–713

# Orion device manual

## Reset pairing

Hold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.

## Warranty

The warranty lasts two years. Keep your receipt. Accidental water damage is excluded. Contact the support team before returning a device.

## Battery care

Store the device in a cool, dry place. Charge it every three months when unused. Use only the supplied USB-C cable. Recycle batteries at an approved collection point.

## Delivery

Standard delivery takes five working days. Tracked delivery is available in Morocco. Keep the tracking number until the parcel arrives.
Observed stages and scores
[
  {
    "details": {
      "limit": 20,
      "locations": [
        {
          "child_id": "child-3",
          "end": 358,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 265
        },
        {
          "child_id": "child-2",
          "end": 275,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 178
        },
        {
          "child_id": "child-7",
          "end": 704,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 610
        },
        {
          "child_id": "child-1",
          "end": 188,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 89
        },
        {
          "child_id": "child-0",
          "end": 99,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 0
        },
        {
          "child_id": "child-5",
          "end": 533,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 435
        },
        {
          "child_id": "child-4",
          "end": 445,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 348
        },
        {
          "child_id": "child-6",
          "end": 620,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 523
        },
        {
          "child_id": "child-8",
          "end": 713,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 694
        }
      ],
      "query": "How long is the warranty and what damage is excluded?"
    },
    "elapsed_ms": 0.08000199886737391,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "ars. Keep your receipt. Accidental water damage is excluded. Contact the support team before ",
        "rank": 1,
        "score": 2.69175124168396,
        "source_unit_id": "child-3"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "eep USB-C power connected throughout the reset.\n\n## Warranty\n\nThe warranty lasts two years. Keep ",
        "rank": 2,
        "score": 1.2320934534072876,
        "source_unit_id": "child-2"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "ing days. Tracked delivery is available in Morocco. Keep the tracking number until the parcel ",
        "rank": 3,
        "score": 1.2126452922821045,
        "source_unit_id": "child-7"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C ",
        "rank": 4,
        "score": 0.16223493218421936,
        "source_unit_id": "child-1"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. ",
        "rank": 5,
        "score": 0.10937795042991638,
        "source_unit_id": "child-0"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Charge it every three months when unused. Use only the supplied USB-C cable. Recycle batteries at ",
        "rank": 6,
        "score": 0.10600543022155762,
        "source_unit_id": "child-5"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "am before returning a device.\n\n## Battery care\n\nStore the device in a cool, dry place. Charge it ",
        "rank": 7,
        "score": 0.10283465683460236,
        "source_unit_id": "child-4"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "teries at an approved collection point.\n\n## Delivery\n\nStandard delivery takes five working days. ",
        "rank": 8,
        "score": 0.0,
        "source_unit_id": "child-6"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "he parcel arrives.\n",
        "rank": 9,
        "score": 0.0,
        "source_unit_id": "child-8"
      }
    ],
    "name": "children"
  },
  {
    "details": {
      "query": "How long is the warranty and what damage is excluded?"
    },
    "elapsed_ms": 0.005971996870357543,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 358,
          "matched_child_id": "child-3",
          "matched_child_start": 265,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.69175124168396,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "parent_expansion"
  },
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 1,
      "model_cache": "unknown",
      "query": "How long is the warranty and what damage is excluded?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.0980160002654884,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 358,
          "matched_child_id": "child-3",
          "matched_child_start": 265,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.69175124168396,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 741,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.02166199919884093,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 358,
          "matched_child_id": "child-3",
          "matched_child_start": 265,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.69175124168396,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "context_selection"
  }
]
Q3 · How often should I charge an unused device?Pass · Sufficient evidence713 returned text characters

How often should I charge an unused device?

Q3 · 713 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · manual.md · Source text · Original characters 0–713

# Orion device manual

## Reset pairing

Hold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.

## Warranty

The warranty lasts two years. Keep your receipt. Accidental water damage is excluded. Contact the support team before returning a device.

## Battery care

Store the device in a cool, dry place. Charge it every three months when unused. Use only the supplied USB-C cable. Recycle batteries at an approved collection point.

## Delivery

Standard delivery takes five working days. Tracked delivery is available in Morocco. Keep the tracking number until the parcel arrives.
Observed stages and scores
[
  {
    "details": {
      "limit": 20,
      "locations": [
        {
          "child_id": "child-4",
          "end": 445,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 348
        },
        {
          "child_id": "child-5",
          "end": 533,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 435
        },
        {
          "child_id": "child-6",
          "end": 620,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 523
        },
        {
          "child_id": "child-0",
          "end": 99,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 0
        },
        {
          "child_id": "child-1",
          "end": 188,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 89
        },
        {
          "child_id": "child-2",
          "end": 275,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 178
        },
        {
          "child_id": "child-3",
          "end": 358,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 265
        },
        {
          "child_id": "child-7",
          "end": 704,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 610
        },
        {
          "child_id": "child-8",
          "end": 713,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 694
        }
      ],
      "query": "How often should I charge an unused device?"
    },
    "elapsed_ms": 0.07028399704722688,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "am before returning a device.\n\n## Battery care\n\nStore the device in a cool, dry place. Charge it ",
        "rank": 1,
        "score": 1.2256488800048828,
        "source_unit_id": "child-4"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Charge it every three months when unused. Use only the supplied USB-C cable. Recycle batteries at ",
        "rank": 2,
        "score": 1.209876298904419,
        "source_unit_id": "child-5"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "teries at an approved collection point.\n\n## Delivery\n\nStandard delivery takes five working days. ",
        "rank": 3,
        "score": 0.7703071236610413,
        "source_unit_id": "child-6"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. ",
        "rank": 4,
        "score": 0.5270749926567078,
        "source_unit_id": "child-0"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C ",
        "rank": 5,
        "score": 0.0,
        "source_unit_id": "child-1"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "eep USB-C power connected throughout the reset.\n\n## Warranty\n\nThe warranty lasts two years. Keep ",
        "rank": 6,
        "score": 0.0,
        "source_unit_id": "child-2"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "ars. Keep your receipt. Accidental water damage is excluded. Contact the support team before ",
        "rank": 7,
        "score": 0.0,
        "source_unit_id": "child-3"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "ing days. Tracked delivery is available in Morocco. Keep the tracking number until the parcel ",
        "rank": 8,
        "score": 0.0,
        "source_unit_id": "child-7"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "he parcel arrives.\n",
        "rank": 9,
        "score": 0.0,
        "source_unit_id": "child-8"
      }
    ],
    "name": "children"
  },
  {
    "details": {
      "query": "How often should I charge an unused device?"
    },
    "elapsed_ms": 0.004427998646860942,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 445,
          "matched_child_id": "child-4",
          "matched_child_start": 348,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 1.2256488800048828,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "parent_expansion"
  },
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 1,
      "model_cache": "unknown",
      "query": "How often should I charge an unused device?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.08442000034847297,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 445,
          "matched_child_id": "child-4",
          "matched_child_start": 348,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 1.2256488800048828,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 741,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.019537001207936555,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 445,
          "matched_child_id": "child-4",
          "matched_child_start": 348,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 1.2256488800048828,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "context_selection"
  }
]
Q4 · Where is tracked delivery available?Pass · Sufficient evidence713 returned text characters

Where is tracked delivery available?

Q4 · 713 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · manual.md · Source text · Original characters 0–713

# Orion device manual

## Reset pairing

Hold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.

## Warranty

The warranty lasts two years. Keep your receipt. Accidental water damage is excluded. Contact the support team before returning a device.

## Battery care

Store the device in a cool, dry place. Charge it every three months when unused. Use only the supplied USB-C cable. Recycle batteries at an approved collection point.

## Delivery

Standard delivery takes five working days. Tracked delivery is available in Morocco. Keep the tracking number until the parcel arrives.
Observed stages and scores
[
  {
    "details": {
      "limit": 20,
      "locations": [
        {
          "child_id": "child-7",
          "end": 704,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 610
        },
        {
          "child_id": "child-6",
          "end": 620,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 523
        },
        {
          "child_id": "child-3",
          "end": 358,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 265
        },
        {
          "child_id": "child-0",
          "end": 99,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 0
        },
        {
          "child_id": "child-1",
          "end": 188,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 89
        },
        {
          "child_id": "child-2",
          "end": 275,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 178
        },
        {
          "child_id": "child-4",
          "end": 445,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 348
        },
        {
          "child_id": "child-5",
          "end": 533,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 435
        },
        {
          "child_id": "child-8",
          "end": 713,
          "parent_id": "doc-aaa8b734a101d7f34afb",
          "start": 694
        }
      ],
      "query": "Where is tracked delivery available?"
    },
    "elapsed_ms": 0.07966200064402074,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "ing days. Tracked delivery is available in Morocco. Keep the tracking number until the parcel ",
        "rank": 1,
        "score": 2.4967360496520996,
        "source_unit_id": "child-7"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "teries at an approved collection point.\n\n## Delivery\n\nStandard delivery takes five working days. ",
        "rank": 2,
        "score": 0.8006759881973267,
        "source_unit_id": "child-6"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "ars. Keep your receipt. Accidental water damage is excluded. Contact the support team before ",
        "rank": 3,
        "score": 0.5443947315216064,
        "source_unit_id": "child-3"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. ",
        "rank": 4,
        "score": 0.0,
        "source_unit_id": "child-0"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C ",
        "rank": 5,
        "score": 0.0,
        "source_unit_id": "child-1"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "eep USB-C power connected throughout the reset.\n\n## Warranty\n\nThe warranty lasts two years. Keep ",
        "rank": 6,
        "score": 0.0,
        "source_unit_id": "child-2"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "am before returning a device.\n\n## Battery care\n\nStore the device in a cool, dry place. Charge it ",
        "rank": 7,
        "score": 0.0,
        "source_unit_id": "child-4"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Charge it every three months when unused. Use only the supplied USB-C cable. Recycle batteries at ",
        "rank": 8,
        "score": 0.0,
        "source_unit_id": "child-5"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "he parcel arrives.\n",
        "rank": 9,
        "score": 0.0,
        "source_unit_id": "child-8"
      }
    ],
    "name": "children"
  },
  {
    "details": {
      "query": "Where is tracked delivery available?"
    },
    "elapsed_ms": 0.005029000021750107,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 704,
          "matched_child_id": "child-7",
          "matched_child_start": 610,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.4967360496520996,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "parent_expansion"
  },
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 1,
      "model_cache": "unknown",
      "query": "Where is tracked delivery available?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.09733499973663129,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 704,
          "matched_child_id": "child-7",
          "matched_child_start": 610,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.4967360496520996,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 741,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.02251300247735344,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb",
          "matched_child_end": 704,
          "matched_child_id": "child-7",
          "matched_child_start": 610,
          "returned_context": "full_parent"
        },
        "preview": "# Orion device manual\n\n## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected throughout the reset.\n\n## Warranty\n\n",
        "rank": 1,
        "score": 2.4967360496520996,
        "source_unit_id": "doc-aaa8b734a101d7f34afb"
      }
    ],
    "name": "context_selection"
  }
]

compress

Status: complete

Strategy: bm25 · k=1 · 10 prepared passages

Evidence scope: exact_returned_spans

Reviewed evidence is scored against the union of exact original-text spans.

Extractive compression can remove required facts or qualifications; evidence is rescored from only the returned spans.

Split / sliceSufficient / answerableCoverageMRRPrecision
dev / all3 / 40.8751.01.0
heldout / all0 / 0N/AN/AN/A

Mean query time over 4 known values: 0.45 ms · 0 missing

Mean rendered context: 199.5 characters · Original text characters: 69.0

Supplied-usage cost estimate: N/A · Pricing: unavailable

Configuration, criteria and separate timing trials
{
  "config": {
    "candidate_k": 20,
    "child_overlap": 50,
    "child_size": 500,
    "child_splitter": "none",
    "compression": {
      "endpoint_hash": null,
      "failure": "fail",
      "max_output_tokens": 1024,
      "max_spans": 2,
      "mode": "sentences",
      "model": null,
      "prompt_version": "extractive-spans-v1",
      "provider": "ollama",
      "timeout_seconds": 60.0
    },
    "k": 1,
    "lexical_weight": 0.5,
    "model": null,
    "name": "compress",
    "provider": null,
    "query_variants": {},
    "representation": "body",
    "reranker_model": null,
    "rrf_constant": 60,
    "strategy": "bm25"
  },
  "criteria": {
    "dev": {
      "checks": [],
      "status": "not_requested"
    },
    "heldout": {
      "checks": [],
      "status": "not_requested"
    }
  },
  "repeat_rankings_changed": false,
  "trials": [
    {
      "artifact_directory": "jobs/compress/trial-0/attempt-20261019T152652-fddca4a4d309",
      "resources": {
        "context_characters": {
          "known_count": 4,
          "mean_known": 69.0,
          "missing_count": 0
        },
        "context_unit": "characters",
        "context_units": {
          "known_count": 4,
          "mean_known": 199.5,
          "missing_count": 0
        },
        "index_ms": 0.5941989984421525,
        "model_cache": "unknown",
        "query_ms": {
          "known_count": 4,
          "mean_known": 0.4523267498370842,
          "missing_count": 0
        },
        "runtime_versions": {
          "bm25s": "0.2.14",
          "numpy": "2.5.4"
        },
        "vector_cache": "not_applicable"
      },
      "reused": false,
      "trial": 0
    }
  ]
}
Ranked contexts and stage evidence (4 questions)
Q1 · How long should I hold the reset button, and what power is required?Fail · Insufficient evidence75 returned text characters

How long should I hold the reset button, and what power is required?

Q1 · 75 returned text characters

Fail · Insufficient evidence · Split: dev · Missing: POWER

Rank 1 · Extract 1 · manual.md · Source text · Original characters 23–41

## Reset pairing

Rank 1 · Extract 2 · manual.md · Source text · Original characters 41–98

Hold the reset button for eight seconds to clear pairing.
Observed stages and scores
[
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 20,
      "model_cache": "unknown",
      "query": "How long should I hold the reset button, and what power is required?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.11848500071209855,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light ",
        "rank": 1,
        "score": 2.2885582447052,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "connected throughout the reset.\n\n",
        "rank": 2,
        "score": 0.9809407591819763,
        "source_unit_id": "passage-a9bffaf7e82ff6d02b1e"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "tus light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected ",
        "rank": 3,
        "score": 0.8127185106277466,
        "source_unit_id": "passage-fc31aa14f18cf8b2a89a"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Warranty\n\nThe warranty lasts two years. Keep your receipt. Accidental water damage is excluded. ",
        "rank": 4,
        "score": 0.6282253265380859,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Delivery\n\nStandard delivery takes five working days. Tracked delivery is available in Morocco. ",
        "rank": 5,
        "score": 0.5550644397735596,
        "source_unit_id": "passage-1518103967d65de40d95"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Morocco. Keep the tracking number until the parcel arrives.\n",
        "rank": 6,
        "score": 0.15764456987380981,
        "source_unit_id": "passage-3657f06cb41040af19b1"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "excluded. Contact the support team before returning a device.\n\n",
        "rank": 7,
        "score": 0.11353020370006561,
        "source_unit_id": "passage-6c50fe60990136f40ac3"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "n unused. Use only the supplied USB-C cable. Recycle batteries at an approved collection point.\n\n",
        "rank": 8,
        "score": 0.08988720178604126,
        "source_unit_id": "passage-a73c9da59294e4af482b"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Battery care\n\nStore the device in a cool, dry place. Charge it every three months when unused. ",
        "rank": 9,
        "score": 0.08405247330665588,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n",
        "rank": 10,
        "score": 0.0,
        "source_unit_id": "passage-c341c5c87a667038141c"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "budget_policy": "final context selection keeps whole compressed source groups",
      "failure_policy": "fail",
      "input_ids": [
        "passage-5bdc4916bcb2462d0250",
        "passage-a9bffaf7e82ff6d02b1e",
        "passage-fc31aa14f18cf8b2a89a",
        "passage-4be5e239b1ab47982a8e",
        "passage-1518103967d65de40d95",
        "passage-3657f06cb41040af19b1",
        "passage-6c50fe60990136f40ac3",
        "passage-a73c9da59294e4af482b",
        "passage-32a3368b3b75076e202c",
        "passage-c341c5c87a667038141c"
      ],
      "max_spans_per_source": 2,
      "mode": "sentences",
      "order": "candidate rank, then original character offset",
      "selections": {
        "passage-1518103967d65de40d95": [
          {
            "end": 97,
            "start": 55
          }
        ],
        "passage-32a3368b3b75076e202c": [
          {
            "end": 55,
            "start": 17
          }
        ],
        "passage-3657f06cb41040af19b1": [
          {
            "end": 60,
            "start": 9
          }
        ],
        "passage-4be5e239b1ab47982a8e": [
          {
            "end": 42,
            "start": 13
          },
          {
            "end": 98,
            "start": 61
          }
        ],
        "passage-5bdc4916bcb2462d0250": [
          {
            "end": 18,
            "start": 0
          },
          {
            "end": 75,
            "start": 18
          }
        ],
        "passage-6c50fe60990136f40ac3": [
          {
            "end": 61,
            "start": 9
          }
        ],
        "passage-a73c9da59294e4af482b": [
          {
            "end": 44,
            "start": 9
          }
        ],
        "passage-a9bffaf7e82ff6d02b1e": [
          {
            "end": 31,
            "start": 0
          }
        ],
        "passage-c341c5c87a667038141c": [],
        "passage-fc31aa14f18cf8b2a89a": [
          {
            "end": 70,
            "start": 24
          },
          {
            "end": 98,
            "start": 70
          }
        ]
      },
      "state": "complete"
    },
    "elapsed_ms": 0.3726879986061249,
    "hits": [
      {
        "context_spans": [
          {
            "end": 18,
            "start": 0
          },
          {
            "end": 75,
            "start": 18
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 1,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Reset pairing\n\n",
        "rank": 1,
        "score": 2.2885582447052,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      },
      {
        "context_spans": [
          {
            "end": 31,
            "start": 0
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 2,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "connected throughout the reset.",
        "rank": 2,
        "score": 0.9809407591819763,
        "source_unit_id": "passage-a9bffaf7e82ff6d02b1e"
      },
      {
        "context_spans": [
          {
            "end": 70,
            "start": 24
          },
          {
            "end": 98,
            "start": 70
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 3,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Disconnect the companion app before starting.",
        "rank": 3,
        "score": 0.8127185106277466,
        "source_unit_id": "passage-fc31aa14f18cf8b2a89a"
      },
      {
        "context_spans": [
          {
            "end": 42,
            "start": 13
          },
          {
            "end": 98,
            "start": 61
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 4,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "The warranty lasts two years.",
        "rank": 4,
        "score": 0.6282253265380859,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      },
      {
        "context_spans": [
          {
            "end": 97,
            "start": 55
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 5,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Tracked delivery is available in Morocco.",
        "rank": 5,
        "score": 0.5550644397735596,
        "source_unit_id": "passage-1518103967d65de40d95"
      },
      {
        "context_spans": [
          {
            "end": 60,
            "start": 9
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 6,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Keep the tracking number until the parcel arrives.",
        "rank": 6,
        "score": 0.15764456987380981,
        "source_unit_id": "passage-3657f06cb41040af19b1"
      },
      {
        "context_spans": [
          {
            "end": 61,
            "start": 9
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 7,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Contact the support team before returning a device.",
        "rank": 7,
        "score": 0.11353020370006561,
        "source_unit_id": "passage-6c50fe60990136f40ac3"
      },
      {
        "context_spans": [
          {
            "end": 44,
            "start": 9
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 8,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Use only the supplied USB-C cable.",
        "rank": 8,
        "score": 0.08988720178604126,
        "source_unit_id": "passage-a73c9da59294e4af482b"
      },
      {
        "context_spans": [
          {
            "end": 55,
            "start": 17
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 9,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Store the device in a cool, dry place.",
        "rank": 9,
        "score": 0.08405247330665588,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      }
    ],
    "name": "compression"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 211,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.03204099994036369,
    "hits": [
      {
        "context_spans": [
          {
            "end": 18,
            "start": 0
          },
          {
            "end": 75,
            "start": 18
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 1,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Reset pairing\n\n",
        "rank": 1,
        "score": 2.2885582447052,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      }
    ],
    "name": "context_selection"
  }
]
Q2 · How long is the warranty and what damage is excluded?Pass · Sufficient evidence66 returned text characters

How long is the warranty and what damage is excluded?

Q2 · 66 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · Extract 1 · manual.md · Source text · Original characters 240–269

The warranty lasts two years.

Rank 1 · Extract 2 · manual.md · Source text · Original characters 288–325

 Accidental water damage is excluded.
Observed stages and scores
[
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 20,
      "model_cache": "unknown",
      "query": "How long is the warranty and what damage is excluded?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.09342700286651962,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Warranty\n\nThe warranty lasts two years. Keep your receipt. Accidental water damage is excluded. ",
        "rank": 1,
        "score": 3.4753642082214355,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Delivery\n\nStandard delivery takes five working days. Tracked delivery is available in Morocco. ",
        "rank": 2,
        "score": 1.1101288795471191,
        "source_unit_id": "passage-1518103967d65de40d95"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "excluded. Contact the support team before returning a device.\n\n",
        "rank": 3,
        "score": 0.7659269571304321,
        "source_unit_id": "passage-6c50fe60990136f40ac3"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Morocco. Keep the tracking number until the parcel arrives.\n",
        "rank": 4,
        "score": 0.15764456987380981,
        "source_unit_id": "passage-3657f06cb41040af19b1"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "connected throughout the reset.\n\n",
        "rank": 5,
        "score": 0.14540082216262817,
        "source_unit_id": "passage-a9bffaf7e82ff6d02b1e"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light ",
        "rank": 6,
        "score": 0.13330140709877014,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "tus light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected ",
        "rank": 7,
        "score": 0.09311925619840622,
        "source_unit_id": "passage-fc31aa14f18cf8b2a89a"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "n unused. Use only the supplied USB-C cable. Recycle batteries at an approved collection point.\n\n",
        "rank": 8,
        "score": 0.08988720178604126,
        "source_unit_id": "passage-a73c9da59294e4af482b"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Battery care\n\nStore the device in a cool, dry place. Charge it every three months when unused. ",
        "rank": 9,
        "score": 0.08405247330665588,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n",
        "rank": 10,
        "score": 0.0,
        "source_unit_id": "passage-c341c5c87a667038141c"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "budget_policy": "final context selection keeps whole compressed source groups",
      "failure_policy": "fail",
      "input_ids": [
        "passage-4be5e239b1ab47982a8e",
        "passage-1518103967d65de40d95",
        "passage-6c50fe60990136f40ac3",
        "passage-3657f06cb41040af19b1",
        "passage-a9bffaf7e82ff6d02b1e",
        "passage-5bdc4916bcb2462d0250",
        "passage-fc31aa14f18cf8b2a89a",
        "passage-a73c9da59294e4af482b",
        "passage-32a3368b3b75076e202c",
        "passage-c341c5c87a667038141c"
      ],
      "max_spans_per_source": 2,
      "mode": "sentences",
      "order": "candidate rank, then original character offset",
      "selections": {
        "passage-1518103967d65de40d95": [
          {
            "end": 97,
            "start": 55
          }
        ],
        "passage-32a3368b3b75076e202c": [
          {
            "end": 55,
            "start": 17
          }
        ],
        "passage-3657f06cb41040af19b1": [
          {
            "end": 60,
            "start": 9
          }
        ],
        "passage-4be5e239b1ab47982a8e": [
          {
            "end": 42,
            "start": 13
          },
          {
            "end": 98,
            "start": 61
          }
        ],
        "passage-5bdc4916bcb2462d0250": [
          {
            "end": 75,
            "start": 18
          },
          {
            "end": 93,
            "start": 75
          }
        ],
        "passage-6c50fe60990136f40ac3": [
          {
            "end": 9,
            "start": 0
          },
          {
            "end": 61,
            "start": 9
          }
        ],
        "passage-a73c9da59294e4af482b": [
          {
            "end": 44,
            "start": 9
          }
        ],
        "passage-a9bffaf7e82ff6d02b1e": [
          {
            "end": 31,
            "start": 0
          }
        ],
        "passage-c341c5c87a667038141c": [],
        "passage-fc31aa14f18cf8b2a89a": [
          {
            "end": 70,
            "start": 24
          }
        ]
      },
      "state": "complete"
    },
    "elapsed_ms": 0.24530600057914853,
    "hits": [
      {
        "context_spans": [
          {
            "end": 42,
            "start": 13
          },
          {
            "end": 98,
            "start": 61
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 1,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "The warranty lasts two years.",
        "rank": 1,
        "score": 3.4753642082214355,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      },
      {
        "context_spans": [
          {
            "end": 97,
            "start": 55
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 2,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Tracked delivery is available in Morocco.",
        "rank": 2,
        "score": 1.1101288795471191,
        "source_unit_id": "passage-1518103967d65de40d95"
      },
      {
        "context_spans": [
          {
            "end": 9,
            "start": 0
          },
          {
            "end": 61,
            "start": 9
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 3,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "excluded.",
        "rank": 3,
        "score": 0.7659269571304321,
        "source_unit_id": "passage-6c50fe60990136f40ac3"
      },
      {
        "context_spans": [
          {
            "end": 60,
            "start": 9
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 4,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Keep the tracking number until the parcel arrives.",
        "rank": 4,
        "score": 0.15764456987380981,
        "source_unit_id": "passage-3657f06cb41040af19b1"
      },
      {
        "context_spans": [
          {
            "end": 31,
            "start": 0
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 5,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "connected throughout the reset.",
        "rank": 5,
        "score": 0.14540082216262817,
        "source_unit_id": "passage-a9bffaf7e82ff6d02b1e"
      },
      {
        "context_spans": [
          {
            "end": 75,
            "start": 18
          },
          {
            "end": 93,
            "start": 75
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 6,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Hold the reset button for eight seconds to clear pairing.",
        "rank": 6,
        "score": 0.13330140709877014,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      },
      {
        "context_spans": [
          {
            "end": 70,
            "start": 24
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 7,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Disconnect the companion app before starting.",
        "rank": 7,
        "score": 0.09311925619840622,
        "source_unit_id": "passage-fc31aa14f18cf8b2a89a"
      },
      {
        "context_spans": [
          {
            "end": 44,
            "start": 9
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 8,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Use only the supplied USB-C cable.",
        "rank": 8,
        "score": 0.08988720178604126,
        "source_unit_id": "passage-a73c9da59294e4af482b"
      },
      {
        "context_spans": [
          {
            "end": 55,
            "start": 17
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 9,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Store the device in a cool, dry place.",
        "rank": 9,
        "score": 0.08405247330665588,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      }
    ],
    "name": "compression"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 192,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.026279998564859852,
    "hits": [
      {
        "context_spans": [
          {
            "end": 42,
            "start": 13
          },
          {
            "end": 98,
            "start": 61
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 1,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "The warranty lasts two years.",
        "rank": 1,
        "score": 3.4753642082214355,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      }
    ],
    "name": "context_selection"
  }
]
Q3 · How often should I charge an unused device?Pass · Sufficient evidence80 returned text characters

How often should I charge an unused device?

Q3 · 80 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · Extract 1 · manual.md · Source text · Original characters 396–434

Store the device in a cool, dry place.

Rank 1 · Extract 2 · manual.md · Source text · Original characters 434–476

 Charge it every three months when unused.
Observed stages and scores
[
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 20,
      "model_cache": "unknown",
      "query": "How often should I charge an unused device?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.08580299981986172,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Battery care\n\nStore the device in a cool, dry place. Charge it every three months when unused. ",
        "rank": 1,
        "score": 1.5058517456054688,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "n unused. Use only the supplied USB-C cable. Recycle batteries at an approved collection point.\n\n",
        "rank": 2,
        "score": 1.2111560106277466,
        "source_unit_id": "passage-a73c9da59294e4af482b"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n",
        "rank": 3,
        "score": 0.6842033267021179,
        "source_unit_id": "passage-c341c5c87a667038141c"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "excluded. Contact the support team before returning a device.\n\n",
        "rank": 4,
        "score": 0.5042375326156616,
        "source_unit_id": "passage-6c50fe60990136f40ac3"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light ",
        "rank": 5,
        "score": 0.0,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "tus light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected ",
        "rank": 6,
        "score": 0.0,
        "source_unit_id": "passage-fc31aa14f18cf8b2a89a"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "connected throughout the reset.\n\n",
        "rank": 7,
        "score": 0.0,
        "source_unit_id": "passage-a9bffaf7e82ff6d02b1e"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Warranty\n\nThe warranty lasts two years. Keep your receipt. Accidental water damage is excluded. ",
        "rank": 8,
        "score": 0.0,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Delivery\n\nStandard delivery takes five working days. Tracked delivery is available in Morocco. ",
        "rank": 9,
        "score": 0.0,
        "source_unit_id": "passage-1518103967d65de40d95"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Morocco. Keep the tracking number until the parcel arrives.\n",
        "rank": 10,
        "score": 0.0,
        "source_unit_id": "passage-3657f06cb41040af19b1"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "budget_policy": "final context selection keeps whole compressed source groups",
      "failure_policy": "fail",
      "input_ids": [
        "passage-32a3368b3b75076e202c",
        "passage-a73c9da59294e4af482b",
        "passage-c341c5c87a667038141c",
        "passage-6c50fe60990136f40ac3",
        "passage-5bdc4916bcb2462d0250",
        "passage-fc31aa14f18cf8b2a89a",
        "passage-a9bffaf7e82ff6d02b1e",
        "passage-4be5e239b1ab47982a8e",
        "passage-1518103967d65de40d95",
        "passage-3657f06cb41040af19b1"
      ],
      "max_spans_per_source": 2,
      "mode": "sentences",
      "order": "candidate rank, then original character offset",
      "selections": {
        "passage-1518103967d65de40d95": [],
        "passage-32a3368b3b75076e202c": [
          {
            "end": 55,
            "start": 17
          },
          {
            "end": 97,
            "start": 55
          }
        ],
        "passage-3657f06cb41040af19b1": [],
        "passage-4be5e239b1ab47982a8e": [],
        "passage-5bdc4916bcb2462d0250": [],
        "passage-6c50fe60990136f40ac3": [
          {
            "end": 61,
            "start": 9
          }
        ],
        "passage-a73c9da59294e4af482b": [
          {
            "end": 9,
            "start": 0
          },
          {
            "end": 95,
            "start": 44
          }
        ],
        "passage-a9bffaf7e82ff6d02b1e": [],
        "passage-c341c5c87a667038141c": [
          {
            "end": 23,
            "start": 0
          }
        ],
        "passage-fc31aa14f18cf8b2a89a": []
      },
      "state": "complete"
    },
    "elapsed_ms": 0.1759549995767884,
    "hits": [
      {
        "context_spans": [
          {
            "end": 55,
            "start": 17
          },
          {
            "end": 97,
            "start": 55
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 1,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Store the device in a cool, dry place.",
        "rank": 1,
        "score": 1.5058517456054688,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      },
      {
        "context_spans": [
          {
            "end": 9,
            "start": 0
          },
          {
            "end": 95,
            "start": 44
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 2,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "n unused.",
        "rank": 2,
        "score": 1.2111560106277466,
        "source_unit_id": "passage-a73c9da59294e4af482b"
      },
      {
        "context_spans": [
          {
            "end": 23,
            "start": 0
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 3,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n",
        "rank": 3,
        "score": 0.6842033267021179,
        "source_unit_id": "passage-c341c5c87a667038141c"
      },
      {
        "context_spans": [
          {
            "end": 61,
            "start": 9
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 4,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Contact the support team before returning a device.",
        "rank": 4,
        "score": 0.5042375326156616,
        "source_unit_id": "passage-6c50fe60990136f40ac3"
      }
    ],
    "name": "compression"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 214,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.02223199771833606,
    "hits": [
      {
        "context_spans": [
          {
            "end": 55,
            "start": 17
          },
          {
            "end": 97,
            "start": 55
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 1,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "Store the device in a cool, dry place.",
        "rank": 1,
        "score": 1.5058517456054688,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      }
    ],
    "name": "context_selection"
  }
]
Q4 · Where is tracked delivery available?Pass · Sufficient evidence55 returned text characters

Where is tracked delivery available?

Q4 · 55 returned text characters

Pass · Sufficient evidence · Split: dev · Missing: none

Rank 1 · Extract 1 · manual.md · Source text · Original characters 564–577

## Delivery

Rank 1 · Extract 2 · manual.md · Source text · Original characters 619–661

 Tracked delivery is available in Morocco.
Observed stages and scores
[
  {
    "details": {
      "index_cache": "not_applicable",
      "limit": 20,
      "model_cache": "unknown",
      "query": "Where is tracked delivery available?",
      "runtime_versions": {
        "bm25s": "0.2.14",
        "numpy": "2.5.4"
      }
    },
    "elapsed_ms": 0.130978998640785,
    "hits": [
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Delivery\n\nStandard delivery takes five working days. Tracked delivery is available in Morocco. ",
        "rank": 1,
        "score": 3.3280820846557617,
        "source_unit_id": "passage-1518103967d65de40d95"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Warranty\n\nThe warranty lasts two years. Keep your receipt. Accidental water damage is excluded. ",
        "rank": 2,
        "score": 0.5351060628890991,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "# Orion device manual\n\n",
        "rank": 3,
        "score": 0.0,
        "source_unit_id": "passage-c341c5c87a667038141c"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Reset pairing\n\nHold the reset button for eight seconds to clear pairing. The status light ",
        "rank": 4,
        "score": 0.0,
        "source_unit_id": "passage-5bdc4916bcb2462d0250"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "tus light flashes twice. Disconnect the companion app before starting. Keep USB-C power connected ",
        "rank": 5,
        "score": 0.0,
        "source_unit_id": "passage-fc31aa14f18cf8b2a89a"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "connected throughout the reset.\n\n",
        "rank": 6,
        "score": 0.0,
        "source_unit_id": "passage-a9bffaf7e82ff6d02b1e"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "excluded. Contact the support team before returning a device.\n\n",
        "rank": 7,
        "score": 0.0,
        "source_unit_id": "passage-6c50fe60990136f40ac3"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Battery care\n\nStore the device in a cool, dry place. Charge it every three months when unused. ",
        "rank": 8,
        "score": 0.0,
        "source_unit_id": "passage-32a3368b3b75076e202c"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "n unused. Use only the supplied USB-C cable. Recycle batteries at an approved collection point.\n\n",
        "rank": 9,
        "score": 0.0,
        "source_unit_id": "passage-a73c9da59294e4af482b"
      },
      {
        "evidence_ids": [],
        "metadata": {
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Morocco. Keep the tracking number until the parcel arrives.\n",
        "rank": 10,
        "score": 0.0,
        "source_unit_id": "passage-3657f06cb41040af19b1"
      }
    ],
    "name": "retrieval"
  },
  {
    "details": {
      "budget_policy": "final context selection keeps whole compressed source groups",
      "failure_policy": "fail",
      "input_ids": [
        "passage-1518103967d65de40d95",
        "passage-4be5e239b1ab47982a8e",
        "passage-c341c5c87a667038141c",
        "passage-5bdc4916bcb2462d0250",
        "passage-fc31aa14f18cf8b2a89a",
        "passage-a9bffaf7e82ff6d02b1e",
        "passage-6c50fe60990136f40ac3",
        "passage-32a3368b3b75076e202c",
        "passage-a73c9da59294e4af482b",
        "passage-3657f06cb41040af19b1"
      ],
      "max_spans_per_source": 2,
      "mode": "sentences",
      "order": "candidate rank, then original character offset",
      "selections": {
        "passage-1518103967d65de40d95": [
          {
            "end": 13,
            "start": 0
          },
          {
            "end": 97,
            "start": 55
          }
        ],
        "passage-32a3368b3b75076e202c": [],
        "passage-3657f06cb41040af19b1": [],
        "passage-4be5e239b1ab47982a8e": [
          {
            "end": 98,
            "start": 61
          }
        ],
        "passage-5bdc4916bcb2462d0250": [],
        "passage-6c50fe60990136f40ac3": [],
        "passage-a73c9da59294e4af482b": [],
        "passage-a9bffaf7e82ff6d02b1e": [],
        "passage-c341c5c87a667038141c": [],
        "passage-fc31aa14f18cf8b2a89a": []
      },
      "state": "complete"
    },
    "elapsed_ms": 0.16995300029520877,
    "hits": [
      {
        "context_spans": [
          {
            "end": 13,
            "start": 0
          },
          {
            "end": 97,
            "start": 55
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 1,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Delivery\n\n",
        "rank": 1,
        "score": 3.3280820846557617,
        "source_unit_id": "passage-1518103967d65de40d95"
      },
      {
        "context_spans": [
          {
            "end": 98,
            "start": 61
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 2,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": " Accidental water damage is excluded.",
        "rank": 2,
        "score": 0.5351060628890991,
        "source_unit_id": "passage-4be5e239b1ab47982a8e"
      }
    ],
    "name": "compression"
  },
  {
    "details": {
      "adapter": "unicode-codepoints-v1",
      "budget": null,
      "count": 181,
      "exact": true,
      "policy": "ranked-whole-passages-v1",
      "scope": "rendered_retrieval_context",
      "skipped": [],
      "unit": "characters"
    },
    "elapsed_ms": 0.02344399763387628,
    "hits": [
      {
        "context_spans": [
          {
            "end": 13,
            "start": 0
          },
          {
            "end": 97,
            "start": 55
          }
        ],
        "evidence_ids": [],
        "metadata": {
          "compression_input_rank": 1,
          "document_id": "doc-aaa8b734a101d7f34afb"
        },
        "preview": "## Delivery\n\n",
        "rank": 1,
        "score": 3.3280820846557617,
        "source_unit_id": "passage-1518103967d65de40d95"
      }
    ],
    "name": "context_selection"
  }
]

Limitations

Generated 2026-10-19T15:26:52.160690+00:00 · Query-stage invocation upper bound 12

Bundled font license
Copyright (c) 2023 Vercel, in collaboration with basement.studio

This Font Software is licensed under the SIL Open Font License, Version 1.1.
This license is copied below, and is also available with a FAQ at:
http://scripts.sil.org/OFL

-----------------------------------------------------------
SIL OPEN FONT LICENSE Version 1.1 - 26 February 2007
-----------------------------------------------------------

PREAMBLE
The goals of the Open Font License (OFL) are to stimulate worldwide
development of collaborative font projects, to support the font creation
efforts of academic and linguistic communities, and to provide a free and
open framework in which fonts may be shared and improved in partnership
with others.

The OFL allows the licensed fonts to be used, studied, modified and
redistributed freely as long as they are not sold by themselves. The
fonts, including any derivative works, can be bundled, embedded,
redistributed and/or sold with any software provided that any reserved
names are not used by derivative works. The fonts and derivatives,
however, cannot be released under any other type of license. The
requirement for fonts to remain under this license does not apply
to any document created using the fonts or their derivatives.

DEFINITIONS
"Font Software" refers to the set of files released by the Copyright
Holder(s) under this license and clearly marked as such. This may
include source files, build scripts and documentation.

"Reserved Font Name" refers to any names specified as such after the
copyright statement(s).

"Original Version" refers to the collection of Font Software components as
distributed by the Copyright Holder(s).

"Modified Version" refers to any derivative made by adding to, deleting,
or substituting -- in part or in whole -- any of the components of the
Original Version, by changing formats or by porting the Font Software to a
new environment.

"Author" refers to any designer, engineer, programmer, technical
writer or other person who contributed to the Font Software.

PERMISSION AND CONDITIONS
Permission is hereby granted, free of charge, to any person obtaining
a copy of the Font Software, to use, study, copy, merge, embed, modify,
redistribute, and sell modified and unmodified copies of the Font
Software, subject to the following conditions:

1) Neither the Font Software nor any of its individual components,
in Original or Modified Versions, may be sold by itself.

2) Original or Modified Versions of the Font Software may be bundled,
redistributed and/or sold with any software, provided that each copy
contains the above copyright notice and this license. These can be
included either as stand-alone text files, human-readable headers or
in the appropriate machine-readable metadata fields within text or
binary files as long as those fields can be easily viewed by the user.

3) No Modified Version of the Font Software may use the Reserved Font
Name(s) unless explicit written permission is granted by the corresponding
Copyright Holder. This restriction only applies to the primary font name as
presented to the users.

4) The name(s) of the Copyright Holder(s) or the Author(s) of the Font
Software shall not be used to promote, endorse or advertise any
Modified Version, except to acknowledge the contribution(s) of the
Copyright Holder(s) and the Author(s) or with their explicit written
permission.

5) The Font Software, modified or unmodified, in part or in whole,
must be distributed entirely under this license, and must not be
distributed under any other license. The requirement for fonts to
remain under this license does not apply to any document created
using the Font Software.

TERMINATION
This license becomes null and void if any of the above conditions are
not met.

DISCLAIMER
THE FONT SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND,
EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO ANY WARRANTIES OF
MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT
OF COPYRIGHT, PATENT, TRADEMARK, OR OTHER RIGHT. IN NO EVENT SHALL THE
COPYRIGHT HOLDER BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY,
INCLUDING ANY GENERAL, SPECIAL, INDIRECT, INCIDENTAL, OR CONSEQUENTIAL
DAMAGES, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING
FROM, OUT OF THE USE OR INABILITY TO USE THE FONT SOFTWARE OR FROM
OTHER DEALINGS IN THE FONT SOFTWARE.