All issues

Search results

pancancer query 1: golden uses ICD-O-3 codes, question says "histology types"

Status: Open.

#107 In ucbepic/DataAgentBench;

· jackn11 opened on Sep 13, 2026

crmarenapro query 13's policy sentence cannot be applied and the golden ignores it

Status: Open.

#105 In ucbepic/DataAgentBench;

· jackn11 opened on Sep 13, 2026

agnews queries 2–4 are unpassable without the stripped labels

Status: Open.

#101 In ucbepic/DataAgentBench;

· jackn11 opened on Sep 13, 2026

query_crmarenapro/query8 golden answer omits eligible agents with zero transfers

Status: Open.

#98 In ucbepic/DataAgentBench;

· jackn11 opened on Sep 9, 2026

Clarify review weighting in Yelp average-rating questions

Status: Open.

#97 In ucbepic/DataAgentBench;

· jackn11 opened on Sep 9, 2026

More validators share the #78 substring-without-word-boundary defect (agnews/query4, bookreview/query1, crmarenapro/query1)

Status: Open.

#93 In ucbepic/DataAgentBench;

· marc-shade opened on Aug 30, 2026

Git LFS budget exceeded — 10 dataset files unfetchable, blocking 10 of 17 datasets

Status: Open.

#60 In ucbepic/DataAgentBench;

· Jarus77 opened on Jun 18, 2026

Peer review request: AANA verifier-gated data-agent architecture

Status: Open.

#48 In ucbepic/DataAgentBench;

· mindbomber opened on May 7, 2026

PATENTS queries: EMA initialization and CPC hierarchy-level definitions are under-specified

Status: Open.

#45 In ucbepic/DataAgentBench;

· sahrizvi opened on May 4, 2026