Automate downloading datasets via Colab
My desktop computer recently broke, and I'm currently working on a small laptop with barely 500mb of space left. I need to download about 100gb of files from the DFAUST dataset. I was wondering if there was a way to write a script that did this.
Wget doesn't work because the downloads must be done on the website itself behind a login. Is there a way to use a form of data scraping to get behind this and automate the download process?
If not, what are your suggestions?
Thank you
Topic colab scraping dataset python
Category Data Science