Google’s new medical LLM, Med-PaLM 2, scored 86.5% on the medical exam MedQA 🤯

Not only that, but a panel of 15 human doctors preferred Med-PaLM 2’s answers over real doctor answers across 1066 standardized questions.

Does this mean that doctors are going to be… twitter.com/i/web/status/1… pic.twitter.com/du9AKlSqLg

25 studies: rebuttals and fact checks don’t do much to change minds. We’re better off training people to spot flaws in logic and data.

The most important part of education is teaching critical thinking skills. pic.twitter.com/VXWqAbt4Z2

Introducing 🌲Tree-of-Thought (ToT), a framework to unleash complex & general problem solving with LLMs, through a deliberate ‘System 2’ tree search.

arxiv.org/abs/2305.10601 pic.twitter.com/IaZZdVeaTW

The existing tools are trained on GPT-3.5, they have high false positive rates (10%+), and they are incredibly easy to defeat.

Also, you cannot ask the AI to identify AI writing either. We need to adapt. pic.twitter.com/qCtarWMJb3