Hugdatafast: huggingface/nlp + fastai

Mensagem copiada/colada do fórum fastai

Hugdatafast: huggingface/nlp :heavy_plus_sign: fastai

An integration to make use of hundreds of datasets with fastai, and some handy transforms to make concatenated dataset like language model dataset.

:inbox_tray: pip install hugdatafast
:open_book: Documentation: https://hugdatafast.readthedocs.io/en/latest/

Doing NLP ?
See if you can turn your data pipeline into just 3 lines. :sunglasses:

The updates will also be tweeted on my Twitter Richard Wang.

1 Curtida