Init data not available: 404 error from Amazon s3

[nealmcb]

I get a 404 error when using the friendly init data option:

$ pypi-data init data
Downloading from https://s3.amazonaws.com/pypi-data/data.tar.bz2
....
urllib2.HTTPError: HTTP Error 404: Not Found

Is there another place we can get the initial data, so we can be more friendly to pypi?

About how big is this dataset these days?

[nealmcb]

For the record, I found 104755 projects in a full_download run which took 5 hours. It used an updated get_remote_metadata() which retries on urllib2.URLError. The file size for pypi serial number 2801076 is 157638603 bytes in my data.tar.bz2

[westurner]

pypi/warehouse#1478 (comment)