-
Notifications
You must be signed in to change notification settings - Fork 218
Add goolfc-2.6.10 toolchain for test_get_toolchain_hierarchy robot test. #2464
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Merged
Merged
Changes from all commits
Commits
Show all changes
4 commits
Select commit
Hold shift + click to select a range
1427ce1
Add goolfc-2.6.10 toolchain for test_get_toolchain_hierarchy robot test.
bartoldeman 517730b
Fix additional tests, to adjust for added test easyconfigs.
bartoldeman 9dca10e
Add a space (houndci-bot)
bartoldeman 59ee644
Fix test.framework.filetools test_search_file with new hwloc eb.
bartoldeman File filter
Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
There are no files selected for viewing
35 changes: 35 additions & 0 deletions
35
test/framework/easyconfigs/test_ecs/f/FFTW/FFTW-3.3.3-GCC-4.8.2-serial.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,35 @@ | ||
| easyblock = 'ConfigureMake' | ||
|
|
||
| name = 'FFTW' | ||
| version = '3.3.3' | ||
| versionsuffix = '-serial' | ||
|
|
||
| homepage = 'http://www.fftw.org' | ||
| description = """FFTW is a C subroutine library for computing the discrete Fourier transform (DFT) | ||
| in one or more dimensions, of arbitrary input size, and of both real and complex data.""" | ||
|
|
||
| toolchain = {'name': 'GCC', 'version': '4.7.2'} | ||
| toolchainopts = {'optarch': True, 'pic': True} | ||
|
|
||
| sources = [SOURCELOWER_TAR_GZ] | ||
| source_urls = [homepage] | ||
|
|
||
| common_configopts = "--enable-threads --enable-openmp --with-pic" | ||
|
|
||
| configopts = [ | ||
| common_configopts + " --enable-single --enable-sse2 --enable-mpi", | ||
| common_configopts + " --enable-long-double --enable-mpi", | ||
| common_configopts + " --enable-quad-precision", | ||
| common_configopts + " --enable-sse2 --enable-mpi", # default as last | ||
| ] | ||
|
|
||
| sanity_check_paths = { | ||
| 'files': ['bin/fftw%s' % x for x in ['-wisdom', '-wisdom-to-conf', 'f-wisdom', 'l-wisdom', 'q-wisdom']] + | ||
| ['include/fftw3%s' % x for x in ['-mpi.f03', '-mpi.h', '.f', '.f03', | ||
| '.h', 'l-mpi.f03', 'l.f03', 'q.f03']] + | ||
| ['lib/libfftw3%s%s.a' % (x, y) for x in ['', 'f', 'l'] for y in ['', '_mpi', '_omp', '_threads']] + | ||
| ['lib/libfftw3q.a', 'lib/libfftw3q_omp.a'], | ||
| 'dirs': ['lib/pkgconfig'], | ||
| } | ||
|
|
||
| moduleclass = 'numlib' |
34 changes: 34 additions & 0 deletions
34
test/framework/easyconfigs/test_ecs/f/FFTW/FFTW-3.3.3-gompic-2.6.10.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,34 @@ | ||
| easyblock = 'ConfigureMake' | ||
|
|
||
| name = 'FFTW' | ||
| version = '3.3.3' | ||
|
|
||
| homepage = 'http://www.fftw.org' | ||
| description = """FFTW is a C subroutine library for computing the discrete Fourier transform (DFT) | ||
| in one or more dimensions, of arbitrary input size, and of both real and complex data.""" | ||
|
|
||
| toolchain = {'name': 'gompic', 'version': '2.6.10'} | ||
| toolchainopts = {'optarch': True, 'pic': True} | ||
|
|
||
| sources = [SOURCELOWER_TAR_GZ] | ||
| source_urls = [homepage] | ||
|
|
||
| common_configopts = "--enable-threads --enable-openmp --with-pic" | ||
|
|
||
| configopts = [ | ||
| common_configopts + " --enable-single --enable-sse2 --enable-mpi", | ||
| common_configopts + " --enable-long-double --enable-mpi", | ||
| common_configopts + " --enable-quad-precision", | ||
| common_configopts + " --enable-sse2 --enable-mpi", # default as last | ||
| ] | ||
|
|
||
| sanity_check_paths = { | ||
| 'files': ['bin/fftw%s' % x for x in ['-wisdom', '-wisdom-to-conf', 'f-wisdom', 'l-wisdom', 'q-wisdom']] + | ||
| ['include/fftw3%s' % x for x in ['-mpi.f03', '-mpi.h', '.f', '.f03', | ||
| '.h', 'l-mpi.f03', 'l.f03', 'q.f03']] + | ||
| ['lib/libfftw3%s%s.a' % (x, y) for x in ['', 'f', 'l'] for y in ['', '_mpi', '_omp', '_threads']] + | ||
| ['lib/libfftw3q.a', 'lib/libfftw3q_omp.a'], | ||
| 'dirs': ['lib/pkgconfig'], | ||
| } | ||
|
|
||
| moduleclass = 'numlib' |
21 changes: 21 additions & 0 deletions
21
test/framework/easyconfigs/test_ecs/g/gcccuda/gcccuda-2.6.10.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,21 @@ | ||
| easyblock = "Toolchain" | ||
|
|
||
| name = 'gcccuda' | ||
| version = '2.6.10' | ||
|
|
||
| homepage = '(none)' | ||
| description = """GNU Compiler Collection (GCC) based compiler toolchain, along with CUDA toolkit.""" | ||
|
|
||
| toolchain = {'name': 'dummy', 'version': 'dummy'} | ||
|
|
||
| comp_name = 'GCC' | ||
| comp_ver = '4.8.2' | ||
| comp = (comp_name, comp_ver) | ||
|
|
||
| # compiler toolchain dependencies | ||
| dependencies = [ | ||
| comp, | ||
| ('CUDA', '5.5.22', '', comp), | ||
| ] | ||
|
|
||
| moduleclass = 'toolchain' |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,27 @@ | ||
| easyblock = "Toolchain" | ||
|
|
||
| name = 'golf' | ||
| version = '2.6.10' | ||
|
|
||
| homepage = '(none)' | ||
| description = """GNU Compiler Collection (GCC) based compiler toolchain, including | ||
| OpenBLAS (BLAS and LAPACK support), and FFTW.""" | ||
|
|
||
| toolchain = {'name': 'dummy', 'version': 'dummy'} | ||
|
|
||
| comp_name = 'GCC' | ||
| comp_ver = '4.8.2' | ||
| comp = (comp_name, comp_ver) | ||
|
|
||
| blaslib = 'OpenBLAS' | ||
| blasver = '0.2.8' | ||
| blassuff = '-LAPACK-3.4.2' | ||
|
|
||
| # compiler toolchain dependencies | ||
| dependencies = [ | ||
| comp, | ||
| (blaslib, blasver, blassuff, comp), | ||
| ('FFTW', '3.3.3', '-serial', comp), | ||
| ] | ||
|
|
||
| moduleclass = 'toolchain' |
30 changes: 30 additions & 0 deletions
30
test/framework/easyconfigs/test_ecs/g/golfc/golfc-2.6.10.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,30 @@ | ||
| easyblock = "Toolchain" | ||
|
|
||
| name = 'golfc' | ||
| version = '2.6.10' | ||
|
|
||
| homepage = '(none)' | ||
| description = """GCC based compiler toolchain __with CUDA support__, and including | ||
| OpenBLAS (BLAS and LAPACK support) and FFTW.""" | ||
|
|
||
| toolchain = {'name': 'dummy', 'version': 'dummy'} | ||
|
|
||
| comp_name = 'GCC' | ||
| comp_ver = '4.8.2' | ||
| comp = (comp_name, comp_ver) | ||
|
|
||
| blaslib = 'OpenBLAS' | ||
| blasver = '0.2.8' | ||
| blassuff = '-LAPACK-3.4.2' | ||
|
|
||
| # compiler toolchain dependencies | ||
| # we need GCC as explicit dependency instead of golf toolchain | ||
| # because of toolchain preperation functions | ||
| dependencies = [ | ||
| comp, # part of golf and gcccuda | ||
| ('CUDA', '5.5.22', '', comp), # part of gcccuda | ||
| (blaslib, blasver, blassuff, comp), | ||
| ('FFTW', '3.3.3', '-serial', comp), | ||
| ] | ||
|
|
||
| moduleclass = 'toolchain' |
23 changes: 23 additions & 0 deletions
23
test/framework/easyconfigs/test_ecs/g/gompic/gompic-2.6.10.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,23 @@ | ||
| easyblock = "Toolchain" | ||
|
|
||
| name = 'gompic' | ||
| version = '2.6.10' | ||
|
|
||
| homepage = '(none)' | ||
| description = """GNU Compiler Collection (GCC) based compiler toolchain along with CUDA toolkit, | ||
| including OpenMPI for MPI support with CUDA features enabled.""" | ||
|
|
||
| toolchain = {'name': 'dummy', 'version': 'dummy'} | ||
|
|
||
| comp_name = 'GCC' | ||
| comp_ver = '4.8.2' | ||
| comp = (comp_name, comp_ver) | ||
|
|
||
| # compiler toolchain dependencies | ||
| dependencies = [ | ||
| comp, # part of gcccuda | ||
| ('CUDA', '5.5.22', '', comp), # part of gcccuda | ||
| ('OpenMPI', '1.7.3', '', ('gcccuda', version)), | ||
| ] | ||
|
|
||
| moduleclass = 'toolchain' |
38 changes: 38 additions & 0 deletions
38
test/framework/easyconfigs/test_ecs/g/goolfc/goolfc-2.6.10.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,38 @@ | ||
| easyblock = "Toolchain" | ||
|
|
||
| name = 'goolfc' | ||
| version = '2.6.10' | ||
|
|
||
| homepage = '(none)' | ||
| description = """GCC based compiler toolchain __with CUDA support__, and including | ||
| OpenMPI for MPI support, OpenBLAS (BLAS and LAPACK support), FFTW and ScaLAPACK.""" | ||
|
|
||
| toolchain = {'name': 'dummy', 'version': 'dummy'} | ||
|
|
||
| comp_name = 'GCC' | ||
| comp_ver = '4.8.2' | ||
| comp = (comp_name, comp_ver) | ||
|
|
||
| # toolchain used to build goolfc dependencies | ||
| comp_mpi_tc_name = 'gompic' | ||
| comp_mpi_tc_ver = version | ||
| comp_mpi_tc = (comp_mpi_tc_name, comp_mpi_tc_ver) | ||
|
|
||
| blaslib = 'OpenBLAS' | ||
| blasver = '0.2.8' | ||
| blassuff = '-LAPACK-3.4.2' | ||
| blas = '-%s-%s%s' % (blaslib, blasver, blassuff) | ||
|
|
||
| # compiler toolchain dependencies | ||
| # we need GCC and OpenMPI as explicit dependencies instead of gompi toolchain | ||
| # because of toolchain preperation functions | ||
| dependencies = [ | ||
| comp, # part of gompic | ||
| ('CUDA', '5.5.22', '', comp), # part of gompic | ||
| ('OpenMPI', '1.7.3', '', ('gcccuda', version)), # part of gompic | ||
| (blaslib, blasver, blassuff, comp), | ||
| ('FFTW', '3.3.3', '', comp_mpi_tc), | ||
| ('ScaLAPACK', '2.0.2', blas, comp_mpi_tc), | ||
| ] | ||
|
|
||
| moduleclass = 'toolchain' |
19 changes: 19 additions & 0 deletions
19
test/framework/easyconfigs/test_ecs/h/hwloc/hwloc-1.8-gcccuda-2.6.10.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,19 @@ | ||
| easyblock = 'ConfigureMake' | ||
|
|
||
| name = 'hwloc' | ||
| version = "1.8" | ||
|
|
||
| homepage = 'http://www.open-mpi.org/projects/hwloc/' | ||
| description = """The Portable Hardware Locality (hwloc) software package provides a portable abstraction | ||
| (across OS, versions, architectures, ...) of the hierarchical topology of modern architectures, including | ||
| NUMA memory nodes, sockets, shared caches, cores and simultaneous multithreading. It also gathers various | ||
| system attributes such as cache and memory information as well as the locality of I/O devices such as | ||
| network interfaces, InfiniBand HCAs or GPUs. It primarily aims at helping applications with gathering | ||
| information about modern computing hardware so as to exploit it accordingly and efficiently.""" | ||
|
|
||
| toolchain = {'name': 'gcccuda', 'version': '2.6.10'} | ||
|
|
||
| source_urls = ['http://www.open-mpi.org/software/hwloc/v%(version_major_minor)s/downloads/'] | ||
| sources = [SOURCE_TAR_GZ] | ||
|
|
||
| moduleclass = 'system' |
53 changes: 53 additions & 0 deletions
53
test/framework/easyconfigs/test_ecs/o/OpenBLAS/OpenBLAS-0.2.8-GCC-4.8.2-LAPACK-3.4.2.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,53 @@ | ||
| easyblock = 'ConfigureMake' | ||
|
|
||
| name = 'OpenBLAS' | ||
| version = '0.2.8' | ||
|
|
||
| lapackver = '3.4.2' | ||
| versionsuffix = '-LAPACK-%s' % lapackver | ||
|
|
||
| homepage = 'http://xianyi.github.com/OpenBLAS/' | ||
| description = """OpenBLAS is an optimized BLAS library based on GotoBLAS2 1.13 BSD version.""" | ||
|
|
||
| toolchain = {'name': 'GCC', 'version': '4.8.2'} | ||
|
|
||
| lapack_src = 'lapack-%s.tgz' % lapackver | ||
| large_src = 'large.tgz' | ||
| timing_src = 'timing.tgz' | ||
| sources = [ | ||
| 'v%(version)s.tar.gz', | ||
| lapack_src, | ||
| large_src, | ||
| timing_src, | ||
| ] | ||
| source_urls = [ | ||
| # order matters, trying to download the LAPACK tarball from GitHub causes trouble | ||
| "http://www.netlib.org/lapack/", | ||
| "http://www.netlib.org/lapack/timing/", | ||
| "https://github.com/xianyi/OpenBLAS/archive/", | ||
| ] | ||
|
|
||
| patches = [ | ||
| # 'OpenBLAS-%s_Makefile-LAPACK-sources.patch' % version, | ||
| (lapack_src, '.'), # copy LAPACK tarball to unpacked OpenBLAS dir | ||
| (large_src, '.'), | ||
| (timing_src, '.'), | ||
| ] | ||
|
|
||
| skipsteps = ['configure'] | ||
|
|
||
| threading = 'USE_THREAD=1' | ||
| buildopts = 'BINARY=64 ' + threading + ' CC="$CC" FC="$F77"' | ||
| installopts = threading + " PREFIX=%(installdir)s" | ||
|
|
||
| # extensive testing can be enabled by uncommenting the line below | ||
| #runtest = 'PATH=.:$PATH lapack-timing' | ||
|
|
||
| sanity_check_paths = { | ||
| 'files': ['include/cblas.h', 'include/f77blas.h', 'include/lapacke_config.h', 'include/lapacke.h', | ||
| 'include/lapacke_mangling.h', 'include/lapacke_utils.h', 'include/openblas_config.h', | ||
| 'lib/libopenblas.a', 'lib/libopenblas.%s' % SHLIB_EXT], | ||
| 'dirs': [], | ||
| } | ||
|
|
||
| moduleclass = 'numlib' |
37 changes: 37 additions & 0 deletions
37
test/framework/easyconfigs/test_ecs/o/OpenMPI/OpenMPI-1.7.3-gcccuda-2.6.10.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,37 @@ | ||
| easyblock = 'ConfigureMake' | ||
|
|
||
| name = 'OpenMPI' | ||
| version = "1.7.3" | ||
|
|
||
| homepage = 'http://www.open-mpi.org/' | ||
| description = """The Open MPI Project is an open source MPI-2 implementation.""" | ||
|
|
||
| toolchain = {'name': 'gcccuda', 'version': '2.6.10'} | ||
|
|
||
| sources = [SOURCELOWER_TAR_GZ] | ||
| source_urls = ['http://www.open-mpi.org/software/ompi/v%(version_major_minor)s/downloads'] | ||
|
|
||
| patches = [ | ||
| 'OpenMPI-%(version)s_common-cuda-lib.patch', | ||
| 'OpenMPI-%(version)s-vt_cupti_events.patch', | ||
| ] | ||
|
|
||
| dependencies = [('hwloc', '1.8')] | ||
|
|
||
| configopts = '--with-threads=posix --enable-shared --enable-mpi-thread-multiple --with-verbs ' | ||
| configopts += '--enable-mpirun-prefix-by-default ' # suppress failure modes in relation to mpirun path | ||
| configopts += '--with-hwloc=$EBROOTHWLOC ' # hwloc support | ||
| configopts += '--with-cuda=$CUDA_HOME ' # CUDA-aware build; N.B. --disable-dlopen is incompatible | ||
|
|
||
| # needed for --with-verbs | ||
| osdependencies = [('libibverbs-dev', 'libibverbs-devel')] | ||
|
|
||
| libs = ["mpi_cxx", "mpi_mpifh", "mpi", "ompitrace", "open-pal", "open-rte", "vt", "vt-hyb", "vt-mpi", "vt-mpi-unify"] | ||
| sanity_check_paths = { | ||
| 'files': ["bin/%s" % binfile for binfile in ["ompi_info", "opal_wrapper", "orterun"]] + | ||
| ["lib/lib%s.%s" % (libfile, SHLIB_EXT) for libfile in libs] + | ||
| ["include/%s.h" % x for x in ["mpi-ext", "mpif-config", "mpif", "mpi", "mpi_portable_platform"]], | ||
| 'dirs': ["include/openmpi/ompi/mpi/cxx"], | ||
| } | ||
|
|
||
| moduleclass = 'mpi' | ||
28 changes: 28 additions & 0 deletions
28
...configs/test_ecs/s/ScaLAPACK/ScaLAPACK-2.0.2-gompic-2.6.10-OpenBLAS-0.2.8-LAPACK-3.4.2.eb
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,28 @@ | ||
| # should be EB_ScaLAPACK, but OK for testing purposes | ||
| easyblock = 'EB_toy' | ||
|
|
||
| name = 'ScaLAPACK' | ||
| version = '2.0.2' | ||
|
|
||
| homepage = 'http://www.netlib.org/scalapack/' | ||
| description = """The ScaLAPACK (or Scalable LAPACK) library includes a subset of LAPACK routines | ||
| redesigned for distributed memory MIMD parallel computers.""" | ||
|
|
||
| toolchain = {'name': 'gompic', 'version': '2.6.10'} | ||
| toolchainopts = {'pic': True} | ||
|
|
||
| source_urls = [homepage] | ||
| sources = ['%(namelower)s-%(version)s.tgz'] | ||
|
|
||
| blaslib = 'OpenBLAS' | ||
| blasver = '0.2.8' | ||
| blassuff = '-LAPACK-3.4.2' | ||
|
|
||
| versionsuffix = "-%s-%s%s" % (blaslib, blasver, blassuff) | ||
|
|
||
| dependencies = [(blaslib, blasver, blassuff)] | ||
|
|
||
| # parallel build tends to fail, so disabling it | ||
| parallel = 1 | ||
|
|
||
| moduleclass = 'numlib' |
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Should we add rdma-core-devel to be consistent with how OpenMPI easyconfigs look now adays?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@akesandgren We could, but it doesn't really matter for these tests, there's little point in keeping the test easyconfigs in sync with the central easyconfigs repo, unless there's a reason for it (e.g. to reproduce a bug or something).
I don't see how having two or three options here matters in any way.