OpenAI's launch of ChatGPT Health introduces a specialized health-focused AI with enhanced privacy and physician-informed safeguards, marking a significant step towards responsible AI use in healthcare. However, this development highlights a critical governance gap: while privacy controls and disclaimers can mitigate harm, they do not provide the forensic evidence needed for accountability in post-incident evaluations. This challenge is not unique to healthcare and is expected to arise in other sectors like finance and insurance as AI systems increasingly influence decision-making. The core issue is not just about generating accurate answers but ensuring that these answers can be substantiated and scrutinized after the fact. This matters because as AI becomes more integrated into critical sectors, the need for accountability and evidence in decision-making processes becomes paramount.
