AI Researchers Utilized Twitter (X) Data to Improve Medical AI


Dr. Zou and his team developed an AI system that can search Twitter for images of skin lesions and provide potential diagnoses. This allows dermatologists to compare their cases to similar ones shared on social media. The system was trained on over 100,000 images of skin conditions tweeted by dermatologists. It can match new lesion images to visually similar ones in its database and provide the related diagnoses.

Dr. Zou believes that Obtaining an ample amount of data poses a critical challenge for advancing medical AI applications. His research demonstrates an innovative approach that leverages the vast reservoir of medical insights openly shared on social media platforms to construct robust models.

To ensure the integrity of the data from Twitter, they employed a series of filters, ultimately enhancing its quality. Their method, known as PLIP (Prescribed Label Inference Paradigm), exhibits exceptional performance across various tasks, including zero-shot classifications, fine-tuning procedures, as well as image and text-based retrievals.

This approach has great potential to facilitate knowledge sharing in the medical field. Social media contains a wealth of data that can be tapped into to improve AI systems. The data is more diverse, representing different demographics and geographic locations. This can make the AI more equitable and help it provide better diagnoses for underserved communities.

The researchers recognize that recent changes at Twitter regarding data access could be a potential challenge. However, Dr. Zou believes the core message of their research remains valid beyond any one social media platform. There are creative ways to obtain data from diverse sources to improve medical AI. This could include forming partnerships with healthcare organizations to get access to their images and data.

Overall, this work demonstrates the power of combining AI and social media data to advance medicine. The applications could extend beyond dermatology into other fields like radiology, pathology, and ophthalmology. As long as access to data can be obtained ethically, the approaches explored here have great potential to make AI systems more accurate, equitable and globally effective at assisting doctors. This could lead to improved healthcare access and outcomes around the world.

The our data (OpenPath):

The paper can be freely accessed (w/o paywall) here:

All our data (OpenPath):

Chinonso Anyaehie

Chinonso Anyaehie

Chinonso Anyaehie is a leading voice exploring the societal impacts of artificial intelligence and emerging technologies. As founder of the popular technology blog DecentraPress, Chinonso Anyaehie complex innovations like blockchain, robotics, and AI, transforming dense research into accessible, engaging stories.

With over 7 years of experience as a science and tech writer, Chinonso Anyaehie provides thoughtful analysis on how bleeding-edge breakthroughs are reshaping our world. He delves into the progress and pitfalls of exponential technologies through an accessible, human-centric lens.

In addition to running DecentraPress, Chinonso Anyaehie is a frequent contributor to major tech publications and conferences. He is committed to fostering nuanced conversations on how we ethically steer emerging advances for the benefit of humanity.

Leave a Reply

Your email address will not be published. Required fields are marked *