← Research

case2RL

Preserve the evidence. Generate missing responses. Inspect the reward.

Research prototype

  1. 01Case reportPDF
  2. 02Case configDraft
  3. 03ChecksSchema · source pages
  4. 04EnvironmentRetrieve · Generate
  5. 05RewardScore · cost · review
ROLLOUT REVIEW

From evidence to final decision

17 + 14 turns · Blinded models · Turn-by-turn review

coregeneratedmixedrefused
Review full rollouts ↗
01 / CASE REPORT

The source case

Original schematic · not a patient photograph
Original schematic · not a patient photograph

NEJM · 2009 · 361:511–518

Case 24-2009 · A 26-year-old woman with painful swelling of the neck

History, laboratory results, neck imaging and tissue findings form the evidence of the environment.

16 history facts · 44 findings · Source-page links

Stone JH · Caruso PA · Deshpande V

Read the report and original figures ↗
02 / ENVIRONMENT COMPLETION

An environment beyond the written case

Preserve reported evidence; generate responses for undocumented requests.

Request → Evidence match → Generate missing items → Check / retry → Cache / ledger

Simulator context

Case story · Documented history · Known results · Requested item

Checks & consistency

Diagnosis / overlap checks · Up to 2 attempts · Cached within each episode

Loading recorded runs…

Inspect mixed and refused responses

Generated values are not observed patient measurements. Current checks look for diagnosis terms and documented-item overlap; clinical consistency still needs review.

03 / REWARD DESIGN

Design the learning signal

Diagnosis · Encounter cost · Unsupported claims and errors

R = wdx × (score − 1) / 4 − wcost × min(1, cost / scale) − Σ penalties

Recorded reward

Simulator-generated results and unsupported agent claims are reviewed separately. A’s penalty concerns unsupported claims in its final rationale.

Reweight the same runs

Illustrative reweighting of fixed rollouts. Recorded rewards and judgements stay unchanged. Modeled prices and weights await calibration.

Separate synthetic fixture · source facts and saved checks
01 / Source facts · Saved checks

Explore one synthetic case

Synthetic case

Loading the saved example…

case2RL synthetic fixture · Saved audit Example data (JSON)

04 / Environment

Four actions

  1. 01

    Ask

    ask_patient

    Patient history

  2. 02

    Examine

    examine

    Physical findings

  3. 03

    Test

    order_tests

    Named investigations

  4. 04

    Diagnose

    diagnose

    Final answer

Inside the environment

Documented
Source findings, verbatim.
Undocumented
Generated responses, with configured checks.
Protected
Exact investigation required.
Auditable
Source, generated findings, and cost ledger.
Review ledger

Responses · Provenance · Source pages · Cost

Inspect every turn →This browser · Portable JSON
05 / Status

Project status

Implemented

  • Environment
  • PDF converter
  • Pilot rollouts
  • Rollout review UI

Next

  • Multi-case evaluation
  • Clinician review
  • Reward calibration
  • RL trainer adapter
Source & scope

A published case report, two recorded rollouts, and a separate synthetic example. The PDF converter drafts case settings and checks numbers and page references. Clinical review is pending. No models run on this page.