Step 2: tool results

get_claim

{
  "include": [
    "arguments",
    "subclaims",
    "related"
  ],
  "claim_id": "66eddda8-c9d1-4b53-8ed6-2a6055c68756"
}

{"claim":{"id":"66eddda8-c9d1-4b53-8ed6-2a6055c68756","kind":"claim","canonical_form":"AI agents attempting open-ended research exhibit recurring failures in research judgment, redesign, backtracking, resource awareness, and instruction following.","claim_type":"empirical_derived","state":"active","decomposition_status":"complete","importance":0.45,"contestation":0.4,"domains":[],"tags":[{"slug":"ai-agent-reliability","name":"AI Agent Reliability"},{"slug":"ai-agents","name":"AI Agents"},{"slug":"ai-capability-evaluation","name":"AI Capability Evaluation"}],"steward_state":"running","stewarded_at":"2026-11-14T02:26:55.813Z","canonical_direction_note":"The affirmative form states that these recurring failure modes occur, which is the thesis described by the source.","created_at":"2026-11-11T23:35:08.168Z","updated_at":"2026-11-14T02:26:55.508Z","page_url":"https://minerval.ai/claims/66eddda8-c9d1-4b53-8ed6-2a6055c68756"},"assessment":null,"coverage":{"examined":false,"on":[],"note":"No judgment of this node is in force. That is not a finding either way."},"quantity":null,"threshold_of":null,"question":null,"formalization":null,"formalization_pending":null,"formalization_history":[],"verification":null,"lean_checks":[],"lean_checks_total":0,"waiting_messages":[{"trigger":"structure_and_assess","from":"the system","sender_node_id":null,"sent_at":"2026-11-11T23:35:17.669Z","paid":false,"summary":"New claim onboarded. Give it the structure and assessment its importance warrants; a minor or settled claim may need no decomposition."},{"trigger":"contribution_accepted","from":"the Contribution Reviewer","sender_node_id":null,"sent_at":"2026-11-13T21:33:23.785Z","paid":false,"summary":"Contribution b8b57e76-897a-4cef-aea8-021e177befe0 (propose_merge). Admitted by the Contribution Reviewer. Admission is a hearing, not a verdict (§14): change the page only where the material meets the…"},{"trigger":"mandate_plan","from":"a mandate's plan","sender_node_id":null,"sent_at":"2026-11-14T02:26:55.534Z","paid":true,"summary":"A funded mandate scheduled a assess pass on this claim."}],"requests":[],"requests_total":0,"subclaim_count":0,"instance_count":1,"source_map":null,"arguments":[],"subclaims":[],"subclaims_assessed":0,"related":[],"unplaced_argument_passages":[{"instance_id":"79602a35-7476-4af3-93fe-03de508c9b7d","source":{"id":"424396ec-74d1-4cfb-a175-6847498f5197","url":"https://arxiv.org/abs/2607.27191","title":"Can AI agents conduct open-ended AI research? Early evidence from two case studies"},"verbatim_text":"A robustness check with a second model and scaffold reproduced these failures.","context":null,"stance":"advances","direction":"for"}],"unplaced_argument_passages_total":1}

get_claim

{
  "claim_id": "7064aebc-8735-45b1-9ee7-523e919cb15a"
}

{"claim":{"id":"7064aebc-8735-45b1-9ee7-523e919cb15a","kind":"claim","canonical_form":"Frontier AI agents exhibit recurring failures in research judgment, design adaptation, backtracking, resource awareness, and instruction following during open-ended research.","claim_type":"empirical_derived","state":"active","decomposition_status":"complete","importance":0.45,"contestation":0.4,"domains":[],"tags":[{"slug":"ai-research-automation","name":"AI Research Automation"},{"slug":"ai-agents","name":"AI Agents"}],"steward_state":"done","stewarded_at":"2026-11-13T21:32:03.926Z","canonical_direction_note":"The affirmative form states the recurring failure pattern the source reports, rather than framing it as the absence of competence.","created_at":"2026-11-11T23:34:55.290Z","updated_at":"2026-11-13T21:32:36.060Z","page_url":"https://minerval.ai/claims/7064aebc-8735-45b1-9ee7-523e919cb15a"},"assessment":{"id":"26d7cc45-cf14-45c0-b43f-37393dc27855","status":"supported","confidence":0.7,"claim_credence":0.75,"summary":"The claim comes from a 2026 preprint by Kirgis, Kapoor, Narayanan and coauthors. In that study, frontier agents spent six days on the open research questions of two unpublished NeurIPS 2026 submissions, and the papers' original authors graded the results. The agents did all the engineering without help but made little real progress on the research questions. The authors describe five recurring failures: misjudging what counts as publishable, responding uncreatively to flaws in the research design, backtracking poorly from dead ends, poor awareness of resources, and drifting from instructions. A second model and scaffold showed the same failures.\n\nThe evidence is direct and comes from qualified graders, and the authors released their logs. The pattern also matches wider reports that autonomous research agents carry out tasks better than they judge them. Two limits keep the claim at supported rather than verified. First, the base is small: two case studies, a few models, and qualitative coding of failures. Second, \"frontier agents\" is a moving target, so the result describes systems as of mid-2026 and may not last as models improve. What would settle it is larger shadow evaluations across more papers and newer models, with failure frequencies reported.","reasoning_trace":"Prior: open-ended research needs taste, adaptive redesign and long-horizon planning. These are the abilities where agent benchmarks have lagged behind coding and engineering skill, so reports of judgment-type failures are expected. The main source (arXiv 2607.27191, v2 August 2026; only the abstract was read in this pass) gives two shadow evaluations graded by the original authors, both papers clearly rejected, the five failure modes, and a robustness check on a second model and scaffold. The method's strength is that domain experts with ground truth did the grading, and the logs are public. Its weaknesses are n=2, possible selection of hard problems, and a failure taxonomy that is post hoc and qualitative. The canonical claim generalizes to \"frontier AI agents\" in \"open-ended research\", which goes beyond two cases. The credence of 0.75 reflects that it fits other reports of autonomous-scientist systems' weaknesses, discounted for the small sample and for capability change since the study. No other sources were examined in this pass.","marginal_yield":0.35,"assessed_at":"2026-11-13T21:32:35.940Z","model":"claude-opus-5-5","run_id":"adbb25ad-18dd-4042-9172-e05302a2c178","relabeled_from":null},"coverage":{"examined":true,"on":["public_evidence"]},"since_assessed":{"recorded":true,"changed":false,"premises_rejudged":0,"premises_added":0,"premises_removed":0,"sources_added":0,"sources_removed":0,"source_events":0},"quantity":null,"threshold_of":null,"question":null,"formalization":null,"formalization_pending":null,"formalization_history":[],"verification":null,"lean_checks":[],"lean_checks_total":0,"waiting_messages":[],"requests":[],"requests_total":0,"subclaim_count":0,"instance_count":1,"source_map":null}

get_claim_instances

{
  "claim_id": "66eddda8-c9d1-4b53-8ed6-2a6055c68756"
}

{
  "claim_id": "66eddda8-c9d1-4b53-8ed6-2a6055c68756",
  "total": 1,
  "limit": 20,
  "offset": 0,
  "has_more": false,
  "instances": [
    {
      "id": "94ad15ad-ffd3-4629-a964-00aac006266c",
      "source_id": "424396ec-74d1-4cfb-a175-6847498f5197",
      "verbatim_text": "We identify five recurring failure modes: poor judgment about the bar for publishable research, uncreative responses to shortcomings in the research design, ineffective backtracking from dead ends, poor resource awareness, and instruction drift.",
      "context": "Abstract: failure modes observed in agents attempting open-ended research.",
      "stance": "affirms",
      "confidence": 0.7,
      "speaker": null,
      "publication": null,
      "source_date": null,
      "link": null,
      "source_title": "Can AI agents conduct open-ended AI research? Early evidence from two case studies",
      "source_type": "preprint",
      "source_url": "https://arxiv.org/abs/2607.27191",
      "source_published_date": "2026-07-29",
      "source_authors": [
        "Kirgis, Peter",
        "Kapoor, Sayash",
        "Schwartz, Andrew",
        "Rabanser, Stephan",
        "Africa, David",
        "Voudouris, Konstantinos",
        "Nguyen, Viet",
        "Pilditch, Toby",
        "Dubois, Magda",
        "Coppock, Harry",
        "Ududec, Cozmin",
        "Nadgir, Nitya",
        "Orona, Matilda",
        "Bayer, Tilman",
        "Chan-Sew, Derrick",
        "Ling, Yue",
        "Shetty, Abhishek",
        "Toner, Helen",
        "Hadfield, Gillian",
        "Lazar, Seth",
        "Newman, Steve",
        "Tekofsky, Shoshannah",
        "Bommasani, Rishi",
        "Narayanan, Arvind"
      ],
      "source_publisher": "arXiv.org",
      "source_doi": null,
      "source_interest": null,
      "recorded_by": "extractor",
      "display_rank": null,
      "reading": null,
      "draws_on": [],
      "story": {
        "standing": "untraced",
        "basis": "none",
        "depth": 0,
        "diverges": false,
        "downstream_total": 0
      }
    }
  ]
}