Support downloading files directly into container

[gedankenstuecke]

As discussed in the comments to this PR, and thanks to the great suggestion by @amandasaurus, this PR adds the ability to download OSM history files directly from Geofabrik into the running docker container.

This is particularly useful when running on MyBinder, as it sidesteps the need to first get a local copy for then re-uploading it, making downloads a lot faster as they are from one cloud into the next, e.g. for the download of the history file for Argentina:

argentina-internal. 100%[===================>] 743.52M  30.5MB/s    in 25s 

Happy to refactor this once #7 is merged in, just wanted to signpost this now already!

[gy-mate]

@gedankenstuecke I'm not really comfortable with entering my username & password into a MyBinder notebook. Are there any alternatives to this (e.g. copying the gf_download_oauth cookie's value from the Developer Console and entering it in the notebook directly) apart from the local setup?

[gedankenstuecke]

@gy-mate I totally understand!

I think your suggestion should work, do you want to give it a try by adapting the wget call in the notebook for that? If it works we could offer both options!

[gedankenstuecke]

I've now merged in @iandees' amazing work on getting the timelapse gifs done into this as well, you can give it a try here.

This still assumes logging into Geofabrik through the notebook itself instead of uploading a cookie or copy/pasting the cookie value.

[gedankenstuecke]

I've added your approach in, just slightly modified to also accept the "copy" of a cookie one can get in Firefox and automatically adjusting the input for that or the one you provided @gy-mate.

I've also written up the documentation for how one would get to access the cookie data (expansions for other browsers are welcome!) and then structured the how-to a bit more, as now we have 3 ways of getting OSM history files.

I'm waiting for my binder to launch to see if it all still works fine there!

[gedankenstuecke]

Okay, tried and it still all works as expected, from my side I'd say it's good for merging!

[gy-mate]

Thank you for adding my suggestions! :)

Just a few grammar fixes.

[gedankenstuecke]

Perfect, thanks so much! Any concerns to this being merged in? (@amandasaurus do you want to press the button if you agree? it feels wrong for me to merge my own PR 😂)

[amandasaurus]

I've read this and nothing jumps out to me as strange. I haven't run it yet, so I trust you there. 😅

I must commend you again on making this software much easier to use for more people. 👏🏻🙏🏻 It's sometimes boring work, to write documentation and instructions, but it really does help people. Thank you! 😁😁😁

[gedankenstuecke]

Thanks so much! 🙏 Seeing people on Mastodon test it and making their first images has been amazing, I'm so glad if it helps more people to use the data!