The tech bros are aware of and even bragging about automation bias:
“Sometimes when our users got used to our product, they would start just kind of blindly trusting it,” said Eli Ben-Joseph, co-founder and CEO of Regard, a company that boasts 1.7 million diagnoses made with its tech, which embeds into a health systems’ medical records.
https://www.politico.com/news/2023/10/28/ai-doctors-healthcare-regulation-00124051