Description
MMMU (A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGI)
🌐 Homepage | 🏆 Leaderboard | 🤗 Dataset | 🤗 Paper | 📖 arXiv | GitHub
🔔News
‼️[2026-02-12] We have released the answers for the test set! You can now evaluate your models on the test set locally! 🎉
🛠️[2024-05-30]: Fixed duplicate option issues in Materials dataset items (validation_Materials_25; test_Materials_17, 242) and content error in validation_Materials_25.… See the full description on the dataset page: https://huggingface.co/datasets/MMMU/MMMU.
What can I do with this?
Tags
task_categories:question-answeringtask_categories:visual-question-answeringtask_categories:multiple-choicelanguage:enlicense:apache-2.0size_categories:10K<n<100Kformat:parquetmodality:imagemodality:textlibrary:datasetslibrary:dasklibrary:polarslibrary:mlcroissantarxiv:2311.16502region:usbiologymedicalfinancechemistrymusic