Setup ol-web1 yet again

[cclauss]

Closes #3880, #3901
Closes #3783

Allow us to convert ol-web1 with a fresh Ubuntu install into an Open Library web node running Python 3.8 on Docker.

The workflow will be:

1. Log into ol-web1 that has a fresh Ubuntu install.
2. Get nginx is running OUTSIDE of Docker
   1. Use github token to git clone github.com/internetarchive/olsystem into /olsystem
   2. Make symbolic links to /etc/nginx/nginx.conf and /etc/nginx/sites-available
   3. Copy ol-web3:/opt/.petabox/seed to ol-web1:/opt/.petabox/seed
   4. sudo systemctl start nginx
3. systemctl status nginx # to ensure it is up-and-running
4. Copy scripts/setup_web1.sh into your home directory.
5. Set environment variables and run setup_web1.sh to and configure docker, openlibrary, olsystem
   • export GITHUB_USERNAME=myusername OL_DOMAIN=myusername OL_BRANCH=Setup-ol-web1-yet-again
   • export GITHUB_TOKEN=mytoken # This required to git clone olsystem
   • ./setup_web1.sh which will run docker-compose.production.yml
   • docker-compose.production.yml will run docker/ol-web-start.sh.
6. BUG the last lines of scripts/setup_web1.sh need to be run manually...
   • systemctl status nginx && cd /opt/openlibrary
   • sudo docker-compose -f docker-compose.yml -f docker-compose.infogami-local.yml \
-f docker-compose.production.yml up --no-deps -d web
   • sudo docker-compose logs --tail=100 -f web
   • OPTIONAL: bash in with sudo docker exec -it openlibrary_web_1 /bin/bash

Technical

Testing

This dangerous code should only be run in non-production environments. It restores ol-web1 to a clean state.

#!/bin/bash

cd /opt/openlibrary
sudo docker-compose down
sudo systemctl disable docker
sudo systemctl stop docker
sudo docker system prune -y
sudo apt-get --purge remove -y docker docker.io docker-compose
sudo rm -fr /opt/containerd /opt/openlibrary /opt/olsystem
ls -l /opt  # nothing

Screenshot

Stakeholders

[cdrini]

Looking good! A few small changes. Also, are the symlinks working now?

[cdrini]

(I went through and "DONE"'d and resolved my comments; for future reference it would great if you could do that :) )

[cclauss]

I am just spinning my wheels on this. I can not rm or chown or sudo the destination files so I can not create the symlinks. What else should I try?

[cdrini]

We tested and it looks like nginx is no longer needed on webnodes \o/ So let's remove those sections.

[cclauss]

Video https://archive.org/details/setup-of-ol-web-1 demonstrates this code in action.

[cdrini]

Lgtm; removing the last reference to nginx. Note I haven't tested running this.