Clinical Notes Image Matching

This dataset provides a comprehensive mapping between de-identified clinical notes and their corresponding diagnostic images, enabling advanced research in multi-modal AI for healthcare. Each entry includes rich metadata for both text and imaging, supporting tasks such as automated diagnosis, cross-modal retrieval, and explainable AI in clinical settings.

  • last updated 12 Jul 2025
  • by GoMask
The brief that made it

Training and benchmarking multi-modal AI models for automated diagnosis

Sample rows

preview · 8 of 200 rows · all 13 columns
note_idstringimage_typestringmatch_confidencefloatsynthetic_flagbooleanmodalitystringimage_idstringpatient_idstringnote_datedateimage_file_pathstringimage_datedatebody_partstringdiagnosisstringnote_textstring
N0001X-ray0.98trueSiemens Ysio MaxIMG0001P100012019-03-12/images/xray/P10001_20190312.png2019-03-12ChestNormal studyChest X-ray shows clear lung fields and no acute pathology.
N0002MRI0.94falseSiemens AvantoIMG0002P100022022-07-09/mri/P10002_brain_20220709.nii2022-07-09BrainMultiple sclerosisMRI brain demonstrates multiple periventricular lesions suggestive of MS.
N0003CT0.89trueToshiba Aquilion OneIMG0003P100032020-05-21/ct/P10003_chest_20200521.dcm2020-05-21ChestViral pneumoniaCT scan of chest reveals bilateral ground-glass opacities, likely viral pneumonia.
N0004Ultrasound0.82trueGE Logiq E9IMG0004P100042021-02-17/ultrasound/P10004_abdomen_20210217.dcm2021-02-17AbdomenMild hepatomegalyUltrasound of abdomen shows mild hepatomegaly without focal lesions.
N0005PET0.71trueSiemens Biograph mCTIMG0005P100052023-11-01pet/P10005_20231101.img2023-11-01ChestLymphoma suspicionPET scan reveals increased uptake in mediastinal nodes. Lymphoma cannot be excluded.
N0006MRI0.91falseGE Discovery MR750IMG0006P100062021-06-05/mri/spine/P10006_lumbar_20210605.nii2021-06-05SpineLumbar disc herniationMRI spine shows disc bulge at L4-L5 with mild nerve root impingement.
N0007X-ray0.95trueCanon RadrexIMG0007P100072018-12-26/images/xray/P10007_20181226.jpg2018-12-26KneeMild osteoarthritisX-ray of left knee shows early signs of osteoarthritis.
N0008CT0.93trueSiemens Somatom ForceIMG0008P100082020-01-13/ct/P10008_head_20200113.dcm2020-01-13HeadNormal studyCT head shows no acute intracranial abnormality.

What the 200 rows show

from the 200-row sample

PET (image type) stands out: mean match_confidence is 0.51, against 0.83 for the rest.

  • 85%synthetic_flag = true
  • 0.85median match_confidence
  • 12body parts
Mean match_confidence by image_type200 rows
00.510.94X-ray49 rows0.86MRI39 rows0.83CT43 rows0.78Ultra…38 rows0.51PET25 rows0.00Other6 rows
match_confidence200 rows, in bands of 0.1
0357012000071333676800.51match_confidence →

Median 0.85, from 0.0 to 0.99.

modality192 rows with a value · 8 left blank
  1. GE Discovery MR75014
  2. Siemens Ysio Max13
  3. GE Logiq E913
  4. Samsung HS70A13
  5. Philips Ingenia12
  6. Siemens Somatom Force11
  7. Canon CXDI11
  8. GE Discovery IQ11
  9. Siemens Avanto10
  10. Siemens Biograph mCT10
13 columns by typefrom the column list below
  • string 9
  • float 1
  • date 2
  • boolean 1

Columns

13 columns in four groups
blueprint · 13 columns
columntypedescriptionexample
Text 9 columns
note_idstringUnique identifier for the clinical note entry.uniqueN0001
image_idstringUnique identifier for the diagnostic image associated with the note.IMG0001
patient_idstringDe-identified unique identifier for the patient.P10001
note_textstringDe-identified clinical note or report text describing the case.Chest X-ray shows clear l…
image_typestringType of diagnostic image (e.g., X-ray, MRI, CT, Ultrasound).6 valuesX-ray
image_file_pathstringFile path or URI to the diagnostic image file.pet/P10005_20231101.img
modalitystringImaging modality or equipment used (e.g., Siemens Avanto, GE Discovery).optionalSiemens Ysio Max
body_partstringBody part or anatomical region imaged (e.g., Chest, Head, Abdomen).12 parts · optionalChest
diagnosisstringPrimary diagnosis or finding described in the note or image.optionalNormal study
Numbers 1 column
match_confidencefloatConfidence score (0-1) indicating the reliability of the note-image match.0 to 1 · optional0.98
Dates and times 2 columns
note_datedateDate when the clinical note was recorded.2019-03-12
image_datedateDate when the diagnostic image was captured.2019-03-12
True or false 1 column
synthetic_flagbooleanIndicates whether the entry is synthetic (true) or real (false).true

Use it for

  • synthetic flag85%169 of 200 rowsmean match confidence…0.94X-ray0.86MRI0.83CT0.78Ultr…

    A healthcare dashboard

    The synthetic_flag rate, match_confidence by image_type and a breakdown of modality. Excel, Power BI or Tableau.

  • Why do the 25 PET rows have a mean match_confidence of 0.51?

    A root-cause class exercise

    Hand out the rows and one question. The answer is in the data, not in the brief.

  • A software demo

    Believable notes with image_id, patient_id and note_text to fill a screen in front of a buyer.

Not quite right?

Make it yours.

Same 13 columns, your size and your rules. See 20 rows before you pay.

Preview 20 rows free

1,000 rows: $1.99 · 10,000: $12.99One-time. No subscription. All prices

This dataset200 rows13 columns
Yours1,000 rows13 columns

blueprint · clinical-notes-image-matching

Behind this dataset

Same schema. As many rows as you need.

These 200 rows came out of a blueprint — 13 columns with generation rules behind each one. Open it in Data Factory to retune a column, add your own, wire in foreign keys, and run it at the size you actually need.

Rules it was built with
  • Each patient visit includes one clinical note and one image
  • Diagnosis codes align with provided imaging findings
  • Randomize patient demographics for privacy
  • Imaging modality varies (X-ray, MRI, CT)
  • Clinical notes contain both structured and unstructured text
Rows
Open the blueprint in Data Factory

1 credit per row. Preview 20 rows free. Buy rows for the full run.

Exports
CSV, JSON, JSONL, Parquet, SQL, Excel, TSV, XML
Licence
yours to use, including commercially
API slug
clinical-notes-image-matching

What should your data show?

Preview 20 rows free
No signup. No card.