PSA: General-purpose multimodal models, like Gemini 2.0, Grok-2, and GPT-4o are NOT good at interpreting medical images. This is expected, as they were not trained for this purpose. Last week, I shared a video of Gemini 2.0 Realtime looking at a CT that went viral. It was an extremely... simple case (Case 1 in my call prep course on Navigating Radiology), and I asked very simple questions. Given the context - screensharing with a general model - I was genuinely impressed that it could identify some very basic anatomy and an abnormal pancreas in realtime! The video demonstrated the power of interacting with AI this way, and the potential for future medical-specific models to be used similarly. BUT many reposts of the video perpetuated misconceptions: AI replacing radiologists, Grok can read your scans, etc. Naturally, this video will likely not go viral, but here’s an example of what frequently happens with general-purpose models: many basic errors (calling the prostate the bladder, and the bladder the uterus), seeing masses that don't exist, etc - often probabilistic based on context. That said, interacting with LLMs real time with screensharing IS a very cool unlock, with a lot of potential. Very exciting!show more

Rajesh Bhayana

1,410 subscribers

Поделиться Скачать