正在加载视频...
视频加载失败
✨New study from our team Google DeepMind Google AI - AMIE goes Multimodal✨ Our research conversational diagnostic AI now fluently considers visual photos/tests. In randomized OSCE study AMIE outperformed PCPs in simulated consultations in which patients uploaded photos of skin concerns, ECG tracings or lab tests. Medical dialogue can... show more
10 条评论

We compared AMIE to real PCPs in a randomized, double-blind OSCE study using multimodal instant messaging. AMIE outperformed PCPs in requesting, interpreting and explaining photos during the chat, while still outperforming on other clinical axes such as history-taking, diagnostic accuracy, management reasoning, communication skills, and empathy. (2/n)

The data suggests the scenarios really did test multimodal clinical reasoning. AMIE had higher diagnostic accuracy overall, but diagnostic accuracy dropped for both AMIE and PCPs if they did not appropriately use the images in their clinical reasoning, or if the supplied image was not of high enough quality to be interpretable (3/n)

AMIE is built on our Gemini models @GoogleDeepMind -- our state-aware framework ensures AMIE dynamically adjusts the conversation to multimodal inputs and patient state - targeting follow-up q’s to reduce uncertainty like experienced clinicians. We report strong results on Gemini 2.0 Flash, and our experience with newer Gemini 2.5 models already shows further performance gains (4/n)

As always, there are important limitations we detail in the paper and the results should be interpreted with appropriate caution. Further work is required to safely validate the potential capabilities in prospective settings which we are excited to share more about in due course. Work with an outstanding team including @RyutaroTanno, @KhaledSaab11, @vivnat, @AdamRodmanMD, @timstro, @taotu831, @hardyshakerman, @JanFreyberg, @_cjpark, @yasharmaa, @apalepu13, @arkitus, @weballergy, @valentinlievin, @ckbjimmy, @davidstutz92, @dgtbarrett, @yongcheng16 @SaraM66905 @AvinatanH48021 @joelle_barral @ymatias @pushmeet

Coral AI is the most powerful AI for documents. See the difference yourself:

@GoogleDeepMind @GoogleAI Milestone !

@GoogleDeepMind @GoogleAI Awesome 👏

@GoogleDeepMind @GoogleAI Godspeed! We really need patient facing LLM so patients can be empowered and begin to take control of their own health

@GoogleDeepMind @GoogleAI Great work! This is transformative!

@GoogleDeepMind @GoogleAI Multimodal AMIE via @TheAlgoVoice & @NotebookLM

