Skip to content

Add a bootstrap script that can bootstrap Python, EasyBuild and Lmod #1882

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
ocaisa wants to merge 7 commits into from
Closed

Add a bootstrap script that can bootstrap Python, EasyBuild and Lmod #1882

ocaisa wants to merge 7 commits into from

Conversation

@ocaisa
Copy link
Member

@ocaisa ocaisa commented Aug 19, 2016

No description provided.

@ocaisa
Copy link
Member Author

ocaisa commented Aug 19, 2016

Relies on #1880 for offline reproducability

@ocaisa
Copy link
Member Author

ocaisa commented Aug 19, 2016

@fgeorgatos Your dream has finally come true

ocaisa
ocaisa reviewed Aug 19, 2016
View reviewed changes
easybuild/scripts/Python_EasyBuild_Lmod_bootstrap.sh
vscinstall_version_url='https://pypi.python.org/packages/03/d0/291da76d7da921cf8e70dd7db79b0838e0f633655e8f2dd06093d99ce851/vsc-install-0.10.11.tar.gz'
# Where do we get the EasyBuild bootstrap script
#eb_bootstrap_url='https://raw.githubusercontent.com/hpcugent/easybuild-framework/develop/easybuild/scripts/bootstrap_eb.py'
eb_bootstrap_url='https://raw.githubusercontent.com/ocaisa/easybuild-framework/d2734f33613332ff283b24faabd84a727d7883f9/easybuild/scripts/bootstrap_eb.py'
Copy link
Member Author

@ocaisa ocaisa Aug 19, 2016

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This needs to be removed (and the above uncommented) when #1880 is merged

@ocaisa
Copy link
Member Author

ocaisa commented Aug 19, 2016

The usage is simple: ./Python_EasyBuild_Lmod_bootstrap.sh <Target Dir>

@boegel boegel added this to the v2.9.0 milestone Aug 19, 2016
ocaisa
ocaisa reviewed Sep 5, 2016
View reviewed changes
easybuild/scripts/Python_EasyBuild_Lmod_bootstrap.sh
fi
chmod +x $sources/TCL_MOD/modulecmd.tcl
export PATH=$PATH:$sources/TCL_MOD
eval `tclsh $(which modulecmd.tcl) sh autoinit`
Copy link
Member Author

@ocaisa ocaisa Sep 5, 2016 •
edited
Loading

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Need to ensure MODULESHOME is defined before doing this

@ocaisa
Copy link
Member Author

ocaisa commented Sep 7, 2016 •
edited
Loading

@boegel Can I get your opinion on something. I ran this on an absolutely minimal system and there are a few issues. First up you need tcl, zlib-devel and openssl-devel to get a functional Python and the ability to use the TCL module command.
Next is that you need a C++ compiler to pass the sanity checks of ncurses, which is a dep of Lua. Then ncurses needs to be loaded for Lua to work. I can create an ncurses build that doesn't require C++ and statically link that to Lua with a config option which means this script should work on a bare system with those few packages. The problem would be if there are more things built with dummy that actually require g++ to exist (specifically the deps of GCCcore), if so then it's a bit of a waste of time getting around it since the end result is not really functional. Opinion?

@ocaisa
Copy link
Member Author

ocaisa commented Sep 7, 2016

I went ahead and tested, I fall over at binutils. I could probably get a build out I think but might be a bit of effort.

@ocaisa
Copy link
Member Author

ocaisa commented Sep 7, 2016

Ok, binutils will build if I disable ld.gold so it is possible to forego a C++ compiler and build GCCcore

@ocaisa
Copy link
Member Author

ocaisa commented Sep 7, 2016 •
edited
Loading

Aw forget it, GCCcore is failing now, looks like no way around it:
https://gcc.gnu.org/bugzilla/show_bug.cgi?id=63509

@boegel
Copy link
Member

boegel commented Sep 7, 2016

@ocaisa the latest versions of GCC are (partially) written in C++, so I think you'll have a hard time getting that to build without a C++ compiler on the system...

@boegel
Copy link
Member

boegel commented Sep 7, 2016

@ocaisa unless you're willing to build on old version of GCC (that is still C-only), just to provide working C++ compiler, then you can probably get away with only requiring a C compiler on the system

@ocaisa ocaisa mentioned this pull request Sep 7, 2016
Merged
ocaisa added 4 commits September 7, 2016 17:12
Make sure TCL modules tool is always picked up...
d629156 
, has necessary env vars set (even if they are faked) and that EB is set to use it when necessary
zlib and openssl devel packages, tclsh and g++...
4151825 
are essential to get to a functional  python installation and build `GCCcore`
Update Python_EasyBuild_Lmod_bootstrap.sh
c2fbfcf
Also check patch exists
dfb45d7
@boegel boegel modified the milestones: v2.9.0, v2.x Sep 16, 2016
@ocaisa ocaisa closed this Aug 30, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

3.x

Development

Successfully merging this pull request may close these issues.

3 participants

@ocaisa @boegel @LiangFr