Huggingface datasets

Huggingface has forked TFDS and provides a lot of text datasets. See here for more documentation. Next you can find the list of all the datasets that can be used with TFDS.

• acronym_identification

• ade_corpus_v2

• adv_glue

• adversarial_qa

• aeslc

• afrikaans_ner_corpus

• ag_news

• ai2_arc

• air_dialogue

• ajgt_twitter_ar

• allegro_reviews

• allocine

• alt

• amazon_polarity

• amazon_reviews_multi

• amazon_us_reviews

• ambig_qa

• americas_nli

• ami

• amttl

• anli

• app_reviews

• aqua_rat

• aquamuse

• ar_cov19

• ar_res_reviews

• ar_sarcasm

• arabic_billion_words

• arabic_pos_dialect

• arabic_speech_corpus

• arcd

• arsentd_lev

• art

• arxiv_dataset

• ascent_kb

• aslg_pc12

• asnq

• asset

• assin

• assin2

• atomic

• autshumato

• babi_qa

• banking77

• bbaw_egyptian

• bbc_hindi_nli

• bc2gm_corpus

• beans

• best2009

• bianet

• bible_para

• big_patent

• bigbench

• billsum

• bing_coronavirus_query_set

• biomrc

• biosses

• biwi_kinect_head_pose

• blbooks

• blbooksgenre

• blended_skill_talk

• blimp

• blog_authorship_corpus

• bn_hate_speech

• bnl_newspapers

• bookcorpus

• bookcorpusopen

• boolq

• bprec

• break_data

• brwac

• bsd_ja_en

• bswac

• c3

• c4

• cail2018

• caner

• capes

• casino

• catalonia_independence

• cats_vs_dogs

• cawac

• cbt

• cc100

• cc_news

• ccaligned_multilingual

• cdsc

• cdt

• cedr

• cfq

• chr_en

• cifar10

• cifar100

• circa

• civil_comments

• clickbait_news_bg

• climate_fever

• clinc_oos

• clue

• cmrc2018

• cmu_hinglish_dog

• cnn_dailymail

• coached_conv_pref

• coarse_discourse

• codah

• code_search_net

• code_x_glue_cc_clone_detection_big_clone_bench

• code_x_glue_cc_clone_detection_poj104

• code_x_glue_cc_cloze_testing_all

• code_x_glue_cc_cloze_testing_maxmin

• code_x_glue_cc_code_completion_line

• code_x_glue_cc_code_completion_token

• code_x_glue_cc_code_refinement

• code_x_glue_cc_code_to_code_trans

• code_x_glue_cc_defect_detection

• code_x_glue_ct_code_to_text

• code_x_glue_tc_nl_code_search_adv

• code_x_glue_tc_text_to_code

• code_x_glue_tt_text_to_text

• com_qa

• common_gen

• common_language

• common_voice

• commonsense_qa

• competition_math

• compguesswhat

• conceptnet5

• conceptual_12m

• conceptual_captions

• conll2000

• conll2002

• conll2003

• conll2012_ontonotesv5

• conllpp

• consumer-finance-complaints

• conv_ai

• conv_ai_2

• conv_ai_3

• conv_questions

• coqa

• cord19

• cornell_movie_dialog

• cos_e

• cosmos_qa

• counter

• covid_qa_castorini

• covid_qa_deepset

• covid_qa_ucsd

• covid_tweets_japanese

• covost2

• cppe-5

• craigslist_bargains

• crawl_domain

• crd3

• crime_and_punish

• crows_pairs

• cryptonite

• cs_restaurants

• cuad

• curiosity_dialogs

• daily_dialog

• dane

• danish_political_comments

• dart

• datacommons_factcheck

• dbpedia_14

• dbrd

• deal_or_no_dialog

• definite_pronoun_resolution

• dengue_filipino

• dialog_re

• diplomacy_detection

• disaster_response_messages

• discofuse

• discovery

• disfl_qa

• doc2dial

• docred

• doqa

• dream

• drop

• duorc

• dutch_social

• dyk

• e2e_nlg

• e2e_nlg_cleaned

• ecb

• ecthr_cases

• eduge

• ehealth_kd

• eitb_parcc

• electricity_load_diagrams

• eli5

• eli5_category

• elkarhizketak

• emea

• emo

• emotion

• emotone_ar

• empathetic_dialogues

• enriched_web_nlg

• enwik8

• eraser_multi_rc

• esnli

• eth_py150_open

• ethos

• ett

• eu_regulatory_ir

• eurlex

• euronews

• europa_eac_tm

• europa_ecdc_tm

• europarl_bilingual

• event2Mind

• evidence_infer_treatment

• exams

• factckbr

• fake_news_english

• fake_news_filipino

• farsi_news

• fashion_mnist

• fever

• few_rel

• financial_phrasebank

• finer

• flores

• flue

• food101

• fquad

• freebase_qa

• gap

• gem

• generated_reviews_enth

• generics_kb

• german_legal_entity_recognition

• germaner

• germeval_14

• giga_fren

• gigaword

• glucose

• glue

• gnad10

• go_emotions

• gooaq

• google_wellformed_query

• grail_qa

• great_code

• greek_legal_code

• gsm8k

• guardian_authorship

• gutenberg_time

• hans

• hansards

• hard

• harem

• has_part

• hate_offensive

• hate_speech18

• hate_speech_filipino

• hate_speech_offensive

• hate_speech_pl

• hate_speech_portuguese

• hatexplain

• hausa_voa_ner

• hausa_voa_topics

• hda_nli_hindi

• head_qa

• health_fact

• hebrew_projectbenyehuda

• hebrew_sentiment

• hebrew_this_world

• hellaswag

• hendrycks_test

• hind_encorp

• hindi_discourse

• hippocorpus

• hkcancor

• hlgd

• hope_edi

• hotpot_qa

• hover

• hrenwac_para

• hrwac

• humicroedit

• hybrid_qa

• hyperpartisan_news_detection

• iapp_wiki_qa_squad

• id_clickbait

• id_liputan6

• id_nergrit_corpus

• id_newspapers_2018

• id_panl_bppt

• id_puisi

• igbo_english_machine_translation

• igbo_monolingual

• igbo_ner

• ilist

• imagenet-1k

• imagenet_sketch

• imdb

• imdb_urdu_reviews

• imppres

• indic_glue

• indonli

• indonlu

• inquisitive_qg

• interpress_news_category_tr

• interpress_news_category_tr_lite

• irc_disentangle

• isixhosa_ner_corpus

• isizulu_ner_corpus

• iwslt2017

• jeopardy

• jfleg

• jigsaw_toxicity_pred

• jigsaw_unintended_bias

• jnlpba

• journalists_questions

• kan_hope

• kannada_news

• kd_conv

• kde4

• kelm

• kilt_tasks

• kilt_wikipedia

• kinnews_kirnews

• klue

• kor_3i4k

• kor_hate

• kor_ner

• kor_nli

• kor_nlu

• kor_qpair

• kor_sae

• kor_sarcasm

• labr

• lama

• lambada

• large_spanish_corpus

• laroseda

• lc_quad

• lccc

• lener_br

• lex_glue

• liar

• librispeech_asr

• librispeech_lm

• limit

• lince

• linnaeus

• liveqa

• lj_speech

• lm1b

• lst20

• m_lama

• mac_morpho

• makhzan

• masakhaner

• math_dataset

• math_qa

• matinf

• mbpp

• mc4

• mc_taco

• md_gender_bias

• mdd

• med_hop

• medal

• medical_dialog

• medical_questions_pairs

• medmcqa

• menyo20k_mt

• meta_woz

• metashift

• metooma

• metrec

• miam

• mkb

• mkqa

• mlqa

• mlsum

• mnist

• mocha

• monash_tsf

• moroco

• movie_rationales

• mrqa

• ms_marco

• ms_terms

• msr_genomics_kbcomp

• msr_sqa

• msr_text_compression

• msr_zhen_translation_parity

• msra_ner

• mt_eng_vietnamese

• muchocine

• multi_booked

• multi_eurlex

• multi_news

• multi_nli

• multi_nli_mismatch

• multi_para_crawl

• multi_re_qa

• multi_woz_v22

• multi_x_science_sum

• multidoc2dial

• multilingual_librispeech

• mutual_friends

• mwsc

• myanmar_news

• narrativeqa

• narrativeqa_manual

• natural_questions

• ncbi_disease

• nchlt

• ncslgr

• nell

• neural_code_search

• news_commentary

• newsgroup

• newsph

• newsph_nli

• newspop

• newsqa

• newsroom

• nkjp-ner

• nli_tr

• nlu_evaluation_data

• norec

• norne

• norwegian_ner

• nq_open

• nsmc

• numer_sense

• numeric_fused_head

• oclar

• offcombr

• offenseval2020_tr

• offenseval_dravidian

• ofis_publik

• ohsumed

• ollie

• omp

• onestop_english

• onestop_qa

• open_subtitles

• openai_humaneval

• openbookqa

• openslr

• openwebtext

• opinosis

• opus100

• opus_books

• opus_dgt

• opus_dogc

• opus_elhuyar

• opus_euconst

• opus_finlex

• opus_fiskmo

• opus_gnome

• opus_infopankki

• opus_memat

• opus_montenegrinsubs

• opus_openoffice

• opus_paracrawl

• opus_rf

• opus_tedtalks

• opus_ubuntu

• opus_wikipedia

• opus_xhosanavy

• orange_sum

• oscar

• para_crawl

• para_pat

• parsinlu_reading_comprehension

• pass

• paws

• paws-x

• pec

• peer_read

• peoples_daily_ner

• per_sent

• persian_ner

• pg19

• php

• piaf

• pib

• piqa

• pn_summary

• poem_sentiment

• polemo2

• poleval2019_cyberbullying

• poleval2019_mt

• polsum

• polyglot_ner

• prachathai67k

• pragmeval

• proto_qa

• psc

• ptb_text_only

• pubmed

• pubmed_qa

• py_ast

• qa4mre

• qa_srl

• qa_zre

• qangaroo

• qanta

• qasc

• qasper

• qed

• qed_amara

• quac

• quail

• quarel

• quartz

• quickdraw

• quora

• quoref

• race

• re_dial

• reasoning_bg

• recipe_nlg

• reclor

• red_caps

• reddit

• reddit_tifu

• refresd

• reuters21578

• riddle_sense

• ro_sent

• ro_sts

• ro_sts_parallel

• roman_urdu

• roman_urdu_hate_speech

• ronec

• ropes

• rotten_tomatoes

• russian_super_glue

• rvl_cdip

• s2orc

• samsum

• sanskrit_classic

• saudinewsnet

• sberquad

• sbu_captions

• scan

• scb_mt_enth_2020

• scene_parse_150

• schema_guided_dstc8

• scicite

• scielo

• scientific_papers

• scifact

• sciq

• scitail

• scitldr

• search_qa

• sede

• selqa

• sem_eval_2010_task_8

• sem_eval_2014_task_1

• sem_eval_2018_task_1

• sem_eval_2020_task_11

• sent_comp

• senti_lex

• senti_ws

• sentiment140

• sepedi_ner

• sesotho_ner_corpus

• setimes

• setswana_ner_corpus

• sharc

• sharc_modified

• sick

• silicone

• simple_questions_v2

• siswati_ner_corpus

• smartdata

• sms_spam

• snips_built_in_intents

• snli

• snow_simplified_japanese_corpus

• so_stacksample

• social_bias_frames

• social_i_qa

• sofc_materials_articles

• sogou_news

• spanish_billion_words

• spc

• species_800

• speech_commands

• spider

• squad

• squad_adversarial

• squad_es

• squad_it

• squad_kor_v1

• squad_kor_v2

• squad_v1_pt

• squad_v2

• squadshifts

• srwac

• sst

• stereoset

• story_cloze

• stsb_mt_sv

• stsb_multi_mt

• style_change_detection

• subjqa

• super_glue

• superb

• svhn

• swag

• swahili

• swahili_news

• swda

• swedish_medical_ner

• swedish_ner_corpus

• swedish_reviews

• swiss_judgment_prediction

• tab_fact

• tamilmixsentiment

• tanzil

• tapaco

• tashkeela

• taskmaster1

• taskmaster2

• taskmaster3

• tatoeba

• ted_hrlr

• ted_iwlst2013

• ted_multi

• ted_talks_iwslt

• telugu_books

• telugu_news

• tep_en_fa_para

• text2log

• textvqa

• thai_toxicity_tweet

• thainer

• thaiqa_squad

• thaisum

• the_pile

• the_pile_books3

• the_pile_openwebtext2

• the_pile_stack_exchange

• tilde_model

• time_dial

• times_of_india_news_headlines

• timit_asr

• tiny_shakespeare

• tlc

• tmu_gfm_dataset

• tne

• told-br

• totto

• trec

• trivia_qa

• truthful_qa

• tsac

• ttc4900

• tunizi

• tuple_ie

• turk

• turkic_xwmt

• turkish_movie_sentiment

• turkish_ner

• turkish_product_reviews

• turkish_shrinked_ner

• turku_ner_corpus

• tweet_eval

• tweet_qa

• tweets_ar_en_parallel

• tweets_hate_speech_detection

• twi_text_c3

• twi_wordsim353

• tydiqa

• ubuntu_dialogs_corpus

• udhr

• um005

• un_ga

• un_multi

• un_pc

• universal_dependencies

• universal_morphologies

• urdu_fake_news

• urdu_sentiment_corpus

• vctk

• visual_genome

• vivos

• web_nlg

• web_of_science

• web_questions

• weibo_ner

• wi_locness

• wider_face

• wiki40b

• wiki_asp

• wiki_atomic_edits

• wiki_auto

• wiki_bio

• wiki_dpr

• wiki_hop

• wiki_lingua

• wiki_movies

• wiki_qa

• wiki_qa_ar

• wiki_snippets

• wiki_source

• wiki_split

• wiki_summary

• wikiann

• wikicorpus

• wikihow

• wikipedia

• wikisql

• wikitablequestions

• wikitext

• wikitext_tl39

• wili_2018

• wino_bias

• winograd_wsc

• winogrande

• wiqa

• wisesight1000

• wisesight_sentiment

• wmt14

• wmt15

• wmt16

• wmt17

• wmt18

• wmt19

• wmt20_mlqe_task1

• wmt20_mlqe_task2

• wmt20_mlqe_task3

• wmt_t2t

• wnut_17

• wongnai_reviews

• woz_dialogue

• wrbsc

• x_stance

• xcopa

• xcsr

• xed_en_fi

• xglue

• xnli

• xor_tydi_qa

• xquad

• xquad_r

• xsum

• xsum_factuality

• xtreme

• yahoo_answers_qa

• yahoo_answers_topics

• yelp_polarity

• yelp_review_full

• yoruba_bbc_topics

• yoruba_gv_ner

• yoruba_text_c3

• yoruba_wordsim353

• youtube_caption_corrections

• zest