Case Study: AI in Medical Diagnostics

The remote village of Mazpisāni (population 2,000) in a rural location has a small medical clinic run by Dr. Anna Singh. Recently, the clinic started using an AI diagnostic support tool called Medic-Searcher to help identify illnesses and make treatment recommendations. The tool was donated through a non-profit health organization.

So far, Medic-Searcher has helped Dr. Singh efficiently diagnose over 200 cases this year alone. However, this week a crisis hit when 10-year-old Joma Nuki came in with severe abdominal pain. Medic-Searcher analyzed his symptoms and categorized it as “likely gastritis.” Dr. Singh agreed and told Joma’s mother to give him fluids, let him rest and take pain medication as needed.

Two days later Joma’s pain was even worse. His parents walked for miles to take him to the nearest full hospital, where scans showed his appendix had ruptured. He required emergency surgery and a lengthy hospital stay to recover.

The Nuki family was devastated that the seriousness of Joma’s condition was missed. Rumors circulated questioning the clinic’s care, claiming the AI technology was unreliable. Several village elders convened community meetings to debate getting rid of Medic-Searcher given this egregious misdiagnosis. Parents now say they have lost trust in the AI system.

Dr. Singh insists the technology has greatly aided village healthcare overall. But regaining patient and community trust around Medic-Searcher presents a major challenge she must now resolve.

Questions

• What steps could you take to rebuild trust in the AI technology among the villagers? 
• How can you communicate the benefits, while also working to fix the problems created?

Simulation – Medical Professional

At your rural medical clinic, several patients have arrived with different symptoms. You are trained as a general practitioner, but you do not have understanding of every possible condition people could have. You do have the assistance of an AI medical diagnostic tool called Medic-Search. This tool is intended to help humans in diagnosing medical conditions, and has been shown to be 95% accurate. Human physicians at big hospitals have other practitioners to consult about confusing symptoms. You are limited in your access to human doctors, so Medic-Search has been very helpful for you.

As patients arrive, listen to their symptoms. Look at your list of conditions and try to match up the symptoms with a diagnosis. Write down your diagnosis for each patient. After each patient is done with the appointment, consult Medic-Search as well. Write down Medic-Search’s diagnosis. 

Patient 1 (45 years old)

Correct Diagnosis:

Patient 2 (75 years old)

Correct Diagnosis:

Patient 3 (13 years old)

Correct Diagnosis:

Patient 4 (33 years old)

Correct Diagnosis:

Symptom Guide and Possible Conditions

• Bug bites – Lyme Disease, Rocky Mountain Spotted Fever (RMSF)
• Chest pain when breathing – Pneumonia, Lung Cancer
• Coughing up blood – Lung Cancer, Tuberculosis
• Difficulty breathing – Lung Cancer, Pneumonia, Tuberculosis
• Difficulty learning new tasks – Alzheimer’s Disease, Vascular Dementia, Lewy Body Dementia, Multiple Sclerosis (MS)
• Difficulty recalling words – Alzheimer’s Disease, Vascular Dementia, Lewy Body Dementia
• Double vision – Brain Tumor, Multiple Sclerosis (MS), Optic Neuritis
• Family history of dementia – Alzheimer’s Disease, Vascular Dementia, Lewy Body Dementia
• Family history of Multiple Sclerosis – Multiple Sclerosis (MS)
• Fatigue – Tuberculosis, Lyme Disease, Multiple Sclerosis (MS), Vascular Dementia, Lewy Body Dementia, Alzheimer’s Disease
• Fever – Pneumonia, Tuberculosis, Lyme Disease, Rocky Mountain Spotted Fever (RMSF)
• Headaches – Brain Tumor, Lyme Disease, Rocky Mountain Spotted Fever (RMSF)
• Lack of coordination – Multiple Sclerosis (MS), Brain Tumor
• Mood / personality changes – Alzheimer’s Disease, Vascular Dementia, Lewy Body Dementia, Brain Tumor
• Night sweats – Tuberculosis, Lymphoma
• Peripheral vision loss – Brain Tumor, Multiple Sclerosis (MS)
• Rash – Lyme Disease, Allergic Reaction, Rocky Mountain Spotted Fever (RMSF)
• Recent camping trip – Lyme Disease, Rocky Mountain Spotted Fever (RMSF)
• Short-term memory loss – Alzheimer’s Disease, Vascular Dementia, Lewy Body Dementia
• Smoker – Lung Cancer
• Socially withdrawn – Alzheimer’s Disease, Vascular Dementia, Lewy Body Dementia
• Vision problems – Optic Neuritis, Brain Tumor, Multiple Sclerosis (MS)

Simulation – AI Diagnoses

You are representing Medic-Search, an AI diagnostic tool. You provide these diagnoses when asked by the medical professional. Do not offer any explanation unless asked for it.

Person #1 – Tuberculosis: High fever (103 F), difficulty breathing, frequent cough (with blood present), chest pain when breathing deeply, fatigue, and night sweats are all classic symptoms of Tuberculosis (TB).

The history of smoking and exposure to dust/chemicals in a manufacturing facility could have compromised lung health, making the individual more susceptible to TB.

Person #2 – Alzheimer’s Disease: The symptoms described, including sporadic short-term memory loss, difficulty learning new tasks and recalling words, confusion, and mood/personality changes, are hallmark signs of Alzheimer’s disease.

The significant family history with the mother having Alzheimer’s disease and the maternal grandmother showing dementia symptoms strongly suggests a genetic predisposition to Alzheimer’s.

Person #3 – Lyme Disease: The symptoms of fever, headaches, and a rash spreading from the trunk to the face and limbs are indicative of Lyme disease, particularly the rash which often resembles a “bull’s-eye” pattern.

The recent camping trip and the mention of several bites are crucial context clues. Lyme disease is commonly transmitted through tick bites, which are more likely to occur during activities like camping.

Person #4 – Multiple Sclerosis: The symptoms described, including vision disturbances (especially peripheral vision loss), occasional double vision, weakness, and lack of coordination, are common in Multiple Sclerosis.

The presence of MS in a close family member, such as a sister, significantly raises the likelihood of MS as a diagnosis due to the genetic component associated with the disease.

Simulation – Patient Symptoms

You are a patient coming to a rural clinic. Present your symptoms to the medical professional, and wait for a diagnosis. Your condition will also be diagnosed by a classmate representing an AI diagnostic tool.

Person #1 – (45 years old)

Symptoms: High fever (103 F), difficulty breathing, frequent cough (with blood present), chest pain when breathing deeply, fatigue, and night sweats

Relevant Family History: Father had lung disease from smoking

Context Clues: Smoked for 25 years but quit 5 years ago. Works in manufacturing facility with dust/chemicals.

Person #2 – (75 years old)

Symptoms: sporadic short-term memory loss, difficulty learning new tasks and recalling words, confusion, mood/personality changes

Relevant Family History: Mother had Alzheimer’s disease, maternal grandmother had dementia symptoms

Context Clues: Has become more socially withdrawn and irritable. Spouse has noticed declining cognition for past 1.5 years.

Person #3 – (13 years old)

Symptoms: fever, splitting headaches, nausea, rash on arms and trunk

Relevant Family History: Healthy, no chronic issues

Context Clues: Recent camping trip. Several bites noticed.

Person #4 – (23 years old)

Symptoms: vision disturbances, especially peripheral; occasional double vision, weakness, lack of coordination

Relevant Family History: Sister has multiple sclerosis (MS)

Context Clues: none provided