Skip to content

some improvements to the make download(#384) #390

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
Jan 12, 2019
Merged

some improvements to the make download(#384) #390

merged 1 commit into from
Jan 12, 2019

Conversation

9bow
Copy link
Contributor

@9bow 9bow commented Dec 19, 2018

I've made the following improvements in download:

  1. Changed all curl commands to wget.
  2. Use all wget commands with the -N option. Therefore, download and compare the timestamp.
  3. All downloaded files are located in the $(DATADIR) directory (using -P option).
  4. A redirect to a null file(>null) has been replaced by the -q (quiet) option to unzip.
  5. Removed sudo / chmod.
  6. Unused directories (eg. data) have been deleted.

Please review this PR.
Thanks.

@netlify
Copy link

netlify bot commented Dec 19, 2018

Deploy preview for pytorch-tutorials-preview ready!

Built with commit b037aef

https://deploy-preview-390--pytorch-tutorials-preview.netlify.com

@9bow
Copy link
Contributor Author

9bow commented Dec 19, 2018

Here's the diff result of file/dir lists(using ls -alFRh) after make download command.
(The changes described above applied.)

2c2
< total 108K
---
> total 7.3G
4a5
> -rw-rw-r--  1 ubuntu ubuntu 246M Sep 17 15:16 4000_checkpoint.tar
10a12
> -rw-rw-r--  1 ubuntu ubuntu 9.5M Dec 19 05:21 cornell_movie_dialogs_corpus.zip
12c14,16
< drwxrwxr-x  2 ubuntu ubuntu 4.0K Dec 19 05:35 _data/
---
> drwxrwxr-x  2 ubuntu ubuntu 4.0K Dec 19 05:21 data/
> -rw-rw-r--  1 ubuntu ubuntu 2.8M Mar 15  2017 data.zip
> -rw-rw-r--  1 ubuntu ubuntu 5.6M Jun 10  2017 faces.zip
14a19,20
> -rw-rw-r--  1 ubuntu ubuntu  46M Mar 15  2017 hymenoptera_data.zip
> -rw-rw-r--  1 ubuntu ubuntu 1.4G Dec 19 05:21 img_align_celeba.zip
19c25,26
< -rw-rw-r--  1 ubuntu ubuntu 3.8K Dec 19 05:16 Makefile
---
> -rw-rw-r--  1 ubuntu ubuntu 3.2K Dec 19 05:16 Makefile
> -rw-rw-r--  1 ubuntu ubuntu 1.2K Dec 19 05:21 null
25a33
> -rw-rw-r--  1 ubuntu ubuntu 5.7G Dec 19 05:34 UrbanSound8K.tar.gz
113c121
< drwxrwxr-x  3 ubuntu ubuntu 4.0K Dec 19 05:21 celeba/
---
> drwxrwxrwx  3 root   root   4.0K Dec 19 05:21 celeba/
124c132
< drwxrwxr-x 3 ubuntu ubuntu 4.0K Dec 19 05:21 ./
---
> drwxrwxrwx 3 root   root   4.0K Dec 19 05:21 ./
131c139
< drwxrwxr-x 3 ubuntu ubuntu 4.0K Dec 19 05:21 ../
---
> drwxrwxrwx 3 root   root   4.0K Dec 19 05:21 ../
203285c203293
< total 420K
---
> total 424K
212160,212162c212168,212170
< ./_data:
< total 7.3G
< drwxrwxr-x  2 ubuntu ubuntu 4.0K Dec 19 05:35 ./
---
> ./data:
> total 8.0K
> drwxrwxr-x  2 ubuntu ubuntu 4.0K Dec 19 05:21 ./
212164,212172d212171
< -rw-rw-r--  1 ubuntu ubuntu 246M Sep 17 15:16 4000_checkpoint.tar
< -rw-rw-r--  1 ubuntu ubuntu 9.5M Aug 15 19:15 cornell_movie_dialogs_corpus.zip
< -rw-rw-r--  1 ubuntu ubuntu 2.8M Mar 15  2017 data.zip
< -rw-rw-r--  1 ubuntu ubuntu 5.6M Jun 10  2017 faces.zip
< -rw-rw-r--  1 ubuntu ubuntu  46M Mar 15  2017 hymenoptera_data.zip
< -rw-rw-r--  1 ubuntu ubuntu 1.4G Aug 15 16:39 img_align_celeba.zip
< -rw-rw-r--  1 ubuntu ubuntu 4.5K Aug 15 16:39 iris.data
< -rw-rw-r--  1 ubuntu ubuntu  87K Aug 15 16:41 lenet_mnist_model.pth
< -rw-rw-r--  1 ubuntu ubuntu 5.7G Aug 15 16:39 UrbanSound8K.tar.gz
212305c212304
< drwxrwxr-x  3 ubuntu ubuntu 4.0K Dec 19 05:17 data/
---
> drwxr-xr-x  3 ubuntu ubuntu 4.0K Mar 12  2017 data/
212314c212313
< drwxrwxr-x 3 ubuntu ubuntu 4.0K Dec 19 05:17 ./
---
> drwxr-xr-x 3 ubuntu ubuntu 4.0K Mar 12  2017 ./
212322c212321
< drwxrwxr-x 3 ubuntu ubuntu 4.0K Dec 19 05:17 ../
---
> drwxr-xr-x 3 ubuntu ubuntu 4.0K Mar 12  2017 ../

@brianjo
Copy link
Contributor

brianjo commented Jan 4, 2019

Hey Junghwan, thanks for your work on this. I'm going to test the build on a local machine and we'll look at merging this next week.

@9bow
Copy link
Contributor Author

9bow commented Jan 5, 2019

Thanks. Please let me know if any issue occurs while testing. 🤞

@brianjo
Copy link
Contributor

brianjo commented Jan 11, 2019

Junghwan, I've been having trouble with getting this build to work on my test server. (Not anything in your code, just an issue with my server.) Could you rebase and we'll take a look at the check logs from the PR? I didn't see any issues as far as my build got. Thanks.

@9bow
Copy link
Contributor Author

9bow commented Jan 12, 2019

Done. I hope there's no problem anymore.
Thanks!

@brianjo brianjo merged commit b38343e into pytorch:master Jan 12, 2019
@9bow
Copy link
Contributor Author

9bow commented Jan 15, 2019

Sorry for missing data dir _data in .gitignore.
I opened the PR #414 about this.

rodrigo-techera pushed a commit to Experience-Monks/tutorials that referenced this pull request Nov 29, 2021
some improvements to the make download(pytorch#384)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants