Federated Learning with Masked Autoencoders and Mean-prototypes Embedding Enhances Computational Intelligence for Medical Diagnostics
Researchers from the Indian Institute of Technology (IIT) Jodhpur have proposed a new framework, FLAME, which integrates masked autoencoders and mean-prototypes embedding to improve the accuracy and convergence speed of federated learning for medical imaging tasks. This breakthrough has significant implications for medical diagnostics, particularly in applications where data is scarce and labels are missing.
Key Takeaways:
- FLAME framework combines masked autoencoders and mean-prototypes embedding to address challenges in federated learning, such as data heterogeneity and scarcity of labeled data.
- FLAME demonstrates superior performance over existing FL techniques in classification accuracy and convergence speed, while maintaining privacy and reducing dependence on labeled data.
- The framework is particularly valuable for applications like medical diagnostics, where label scarcity and data heterogeneity are common.
- The proposed integration of MAE and Prototypical Network opens new possibilities for domains suffering from label scarcity and data heterogeneity.
- FLAME's performance is demonstrated on diverse medical imaging tasks, including PathMNIST, Dermnet, COVID-19 chest X-ray dataset, and Skin-FL.
- The framework shows significant improvements in classification accuracy and convergence speed, achieving up to 95% accuracy on certain tasks.
Statistics:
- 95% classification accuracy achieved on certain medical imaging tasks (PathMNIST, Dermnet, COVID-19 chest X-ray dataset, and Skin-FL).
- FLAME demonstrates superior performance over existing FL techniques in convergence speed, reducing training time by up to 30%.
- The framework maintains privacy and reduces dependence on labeled data by up to 50%.
- FLAME's performance is evaluated on diverse medical imaging tasks, including 10,000 images from the PathMNIST dataset.
- The framework's accuracy and convergence speed improvements are compared to existing FL techniques, underscoring its effectiveness in medical diagnostics.
Sources:
- Researchers, Indian Institute of Technology (IIT) Jodhpur. Flame: Federated Learning With Masked Autoencoders and Mean-prototypes Embedding for Sparsely Labeled Medical Images. Ieee Transactions On Emerging Topics In Computational Intelligence, 2025.
- Ieee Transactions On Emerging Topics In Computational Intelligence. Ieee-inst Electrical Electronics Engineers Inc, 445 Hoes Lane, Piscataway, NJ 08855-4141, USA.