Science & ResearchCommercial OK

Measuring Massive Multitask Language Understanding

by cais

Silver64
400.9Kdownloads
695likes
10K<n<100K

Description

Dataset Card for MMLU Dataset Summary Measuring Massive Multitask Language Understanding by Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt (ICLR 2021). This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge. The test spans subjects in the humanities, social sciences, hard sciences, and other areas that are important for some people to learn. This covers 57 tasks… See the full description on the dataset page: https://huggingface.co/datasets/cais/mmlu.

What can I do with this?

Tags

task_categories:question-answeringtask_ids:multiple-choice-qaannotations_creators:no-annotationlanguage_creators:expert-generatedmultilinguality:monolingualsource_datasets:originallanguage:enlicense:mitsize_categories:100K<n<1Mformat:parquetmodality:textlibrary:datasetslibrary:pandaslibrary:polarslibrary:mlcroissantarxiv:2009.03300arxiv:2005.00700arxiv:2005.14165arxiv:2008.02275region:us