Skip to content

It is painful to install gsutil, why not wget/curl #18

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
lgpang opened this issue Feb 15, 2019 · 11 comments
Closed

It is painful to install gsutil, why not wget/curl #18

lgpang opened this issue Feb 15, 2019 · 11 comments

Comments

@lgpang
Copy link

lgpang commented Feb 15, 2019

As shown in title

@lgpang
Copy link
Author

lgpang commented Feb 15, 2019

Even after installed, there are still many errors

sh download_model.sh
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//checkpoint.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//encoder.json.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//hparams.json.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//model.ckpt.data-00000-of-00001.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//model.ckpt.index.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//model.ckpt.meta.
ServiceException: 401 Anonymous caller does not have storage.objects.get access to gpt-2/models//vocab.bpe.

@alfredcs
Copy link

Try to add 117M and see if it makes any difference.

@lopuhin
Copy link

lopuhin commented Feb 15, 2019

It is painful to install gsutil

python2.7 -m pip install gsutil --user worked for me

@dackdel
Copy link

dackdel commented Feb 15, 2019

running linux and having the same storage.objects.get error.

@lgpang
Copy link
Author

lgpang commented Feb 15, 2019

Thanks all of you!
python2.7 -m pip install gsutil --user
and
sh download_model.sh 117M
works to install gsutil and download the pretrained model.
The tricky thing is that under linux gsutil only support python2.7 while I used 3.6.
And the 117M is very important! I thought 117M means that this downloaded file will be 117M,
so did not include that in the beginning.

@nealmcb
Copy link

nealmcb commented Feb 15, 2019

@shayakhmetov
Copy link

pip2 install gsutil worked for me

@ZeweiChu
Copy link

gsutil cp gs://gpt-2/models/117M/encoder.json models/encoder.json
INFO 0215 23:50:10.228441 retry_util.py] Retrying request, attempt #1...
INFO 0215 23:51:11.842244 retry_util.py] Retrying request, attempt #2...
INFO 0215 23:52:15.640549 retry_util.py] Retrying request, attempt #3...

For me it keeps retrying. Anyone knows why?

@WuTheFWasThat
Copy link
Contributor

Sorry I don't have time to test right now but does something like this work?

curl -X GET https://storage.googleapis.com/gpt-2/models/117M/encoder.json

@studiosi
Copy link

Pull Request #39 takes care of this, I believe.

@WuTheFWasThat
Copy link
Contributor

thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

9 participants