Dear Geoff,
Re: https://www.hifa.org/dgroups-rss/artificial-intelligence-7-criteria-and-...
You raise the question of whether AI could be evaluated pre- or without field testing, similar to what you/HIFA proposed for mobile phone apps in 2019:
https://www.hifa.org/sites/default/files/other_publications_uploads/mHIF...
As you say, 'One useful starting point could be to establish appropriate criteria and associated indicators for use of AI in health care in these settings.
Such criteria and indicators would cover for example –
· reliability, relevance, availability, accessibility and confidentiality of information from AI;
· impact on skills, workload and efficiency of health workers;
· impact on healthcare and health;
· wider issues such as equity, sustainability, legality
· costs.'
A parallel starting point might be to consider the different types of AI tools. I asked ChatGPT 'what are the different types of artificial intelligence tools?' and it generated a long and complex list, with the following headings:
1. Machine Learning (ML) Tools
2. Natural Language Processing (NLP) Tools (eg ChatGPT)
3. Computer Vision Tools
4. Robotics and Automation Tools
5. Predictive Analytics and Business Intelligence Tools
6. AI for Code and Software Development
7. Generative AI Tools
8. Speech Recognition and Voice AI Tools
9. AI Infrastructure and Model Hosting Tools
10. Ethical AI and Explainability Tools.
With regards to the original approach for mobile phone apps, I wonder if any progress has been made in, for example, testing the likely usefulness of the app prior to field testing, to avoid predictable failures in the field.
Best wishes, Neil
HIFA profile: Neil Pakenham-Walsh is coordinator of HIFA (Healthcare Information For All), a global health community that brings all stakeholders together around the shared goal of universal access to reliable healthcare information. HIFA has 20,000 members in 180 countries, interacting in four languages and representing all parts of the global evidence ecosystem. HIFA is administered by Global Healthcare Information Network, a UK-based nonprofit in official relations with the World Health Organization. Email: neil@hifa.org