Install the datasets that require manual download about dataset-viewer HOT 4 CLOSED

Not sure if we would be allowed to do that, btw. What do you think datasets maintainers @lhoestq @albertvillanova @mariosasko?

from dataset-viewer.

Yes, we are not allowed to do that for datasets that require login and/or agreeing to TOS.

Currently, 41 canonical datasets require manual download. I checked their scripts and I'm pretty sure this number can be reduced to ≈ 30 by not relying on bash scripts to download data, hosting data directly on the Hub when the license permits, etc. Then, we will mostly be left with datasets with restricted access, which we can ignore.

Will add this task to my to-do list.

from dataset-viewer.

Thanks!

from dataset-viewer.

Superseded by:

• huggingface/datasets#4522, as it's a datasets issue to fix the datasets which license, is not restrictive
• #395, on how to manage the datasets that are explicitly excluded from the API

from dataset-viewer.