Check SciPy test results

[Flamefire]

Similar to #2238 but for SciPy

Supersedes #1744

Note: With SciPy-bundle-2019.03-foss-2019a.eb I get a failure due to a precision issue -.- Same with the 2019b

Those are very small failures, e.g. -0.00077271310043404 != -0.000772713100434114 (rdiff 9.569216326469691e-14) or "Arrays are not almost equal to 5 decimals" ... Max absolute difference: 1.5497208e-05

This is an AMD and Intel CPUs (x86)

[migueldiascosta]

@Flamefire this should be marked as WIP, in terms of what to do regarding the small errors? (according to #2238 (comment))

[ocaisa]

If this passes in other more recent cases, then it is likely the tolerances were changed (or something improved) in later versions. It would be a shame to hold this back because of that, and it's effort to figure out patches to solve this. Given that these tests were effectively being ignored in the past, maintaining previous behaviour might just be disabling the scipy tests in the easyconfigs where these tests are failing?
Thoughts @boegel ?

[Flamefire]

Actually I couldn't get it to work with any scipy :(

Edit: Test report similar to the numpy tests coming up to check a few versions

[Flamefire]

Test report by @Flamefire

Overview of tested easyconfigs (in order)

• FAIL (build issue) SciPy-bundle-2019.03-foss-2019a.eb (partial log available at https://gist.github.com/c131a28e1443d2e06b6716058666ee50)
• FAIL (build issue) SciPy-bundle-2019.10-foss-2019b-Python-2.7.16.eb (partial log available at https://gist.github.com/d379592e60235e320f2fd929e2a9c140)
• FAIL (build issue) SciPy-bundle-2019.10-foss-2019b-Python-3.7.4.eb (partial log available at https://gist.github.com/55e2e566cfe960a3e42cfcf11f4d19c5)
• SUCCESS Python-3.6.6-foss-2018b.eb
• SUCCESS Python-3.6.4-foss-2018a.eb

Build succeeded for 2 out of 5 (5 easyconfigs in total)
taurusi6010.taurus.hrsk.tu-dresden.de - Linux RHEL 7.8, x86_64, Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz, Python 2.7.5
See https://gist.github.com/2e83105d7375d8411448f7bf4e221d40 for a full test report.

[SebastianAchilles]

Test report by @SebastianAchilles

Overview of tested easyconfigs (in order)

• FAIL (build issue) SciPy-bundle-2019.03-foss-2019a.eb (partial log available at https://gist.github.com/34e2438c5693fdba9e3efc094221b3a6)
• FAIL (build issue) SciPy-bundle-2019.03-fosscuda-2019a.eb (partial log available at https://gist.github.com/a6691f2fb05b01c2bf31df692e71b2a9)
• FAIL (build issue) SciPy-bundle-2019.03-intel-2019a.eb (partial log available at https://gist.github.com/e91482eb0484bf67459aeaaf1aa48cdf)
• FAIL (build issue) SciPy-bundle-2019.03-intelcuda-2019a.eb (partial log available at https://gist.github.com/a4daf57a8cc34cd1d9e87a5419b853de)
• FAIL (build issue) SciPy-bundle-2019.10-foss-2019b-Python-2.7.16.eb (partial log available at https://gist.github.com/793084f89211cb7f946d9ba02ce83fa7)
• FAIL (build issue) SciPy-bundle-2019.10-foss-2019b-Python-3.7.4.eb (partial log available at https://gist.github.com/ce5ca354b393f86124ff5a914e5f6223)
• FAIL (build issue) SciPy-bundle-2019.10-fosscuda-2019b-Python-2.7.16.eb (partial log available at https://gist.github.com/67699c7de1b38d133fca57d3283067d5)
• FAIL (build issue) SciPy-bundle-2019.10-fosscuda-2019b-Python-3.7.4.eb (partial log available at https://gist.github.com/f5f64474739dbba9bfb44d5674db0f65)
• FAIL (build issue) SciPy-bundle-2019.10-intel-2019a-Python-3.7.2.eb (partial log available at https://gist.github.com/3cae4c43ed4b8d926aa318ae8c4f0c1a)
• FAIL (build issue) SciPy-bundle-2019.10-intel-2019b-Python-2.7.16.eb (partial log available at https://gist.github.com/8ba4338779210abb598b694cd42f3da7)
• FAIL (build issue) SciPy-bundle-2019.10-intel-2019b-Python-3.7.4.eb (partial log available at https://gist.github.com/530975c8eae47c90e0aa32f24281a72a)
• FAIL (build issue) SciPy-bundle-2019.10-intelcuda-2019b-Python-3.7.4.eb (partial log available at https://gist.github.com/695935f3dc7f3dc241facf12e062a6f8)
• FAIL (build issue) SciPy-bundle-2020.03-foss-2020a-Python-2.7.18.eb (partial log available at https://gist.github.com/20c937e165230fa53f6e1ba74c7c0735)
• SUCCESS SciPy-bundle-2020.03-foss-2020a-Python-3.8.2.eb
• FAIL (build issue) SciPy-bundle-2020.03-fosscuda-2020a-Python-2.7.18.eb (partial log available at https://gist.github.com/315e8d63a9bd84d601959035de127902)
• SUCCESS SciPy-bundle-2020.03-fosscuda-2020a-Python-3.8.2.eb
• FAIL (build issue) SciPy-bundle-2020.03-intel-2020a-Python-2.7.18.eb (partial log available at https://gist.github.com/9fb93280b1d5f484e901902f2a043152)
• FAIL (build issue) SciPy-bundle-2020.03-intel-2020a-Python-3.8.2.eb (partial log available at https://gist.github.com/e77e8a7739e09b28d377dbeeabfd058c)
• FAIL (build issue) SciPy-bundle-2020.03-intelcuda-2020a-Python-3.8.2.eb (partial log available at https://gist.github.com/968347cf29a6ac831924c0f2551906ef)
• FAIL (build issue) SciPy-bundle-2020.11-foss-2020b.eb (partial log available at https://gist.github.com/f356f25cbee9afd293d98e4b6eb06c2d)
• FAIL (build issue) SciPy-bundle-2020.11-foss-2020b-Python-2.7.18.eb (partial log available at https://gist.github.com/d3ecd4039304499f9ced9f0d2d2f2bf6)
• FAIL (build issue) SciPy-bundle-2020.11-fosscuda-2020b.eb (partial log available at https://gist.github.com/e74d2dd9fb73684aab5725ac70236deb)
• FAIL (build issue) SciPy-bundle-2020.11-intel-2020b.eb (partial log available at https://gist.github.com/053f7d3c53135d4442d4c73a1acb2d31)
• FAIL (build issue) SciPy-bundle-2020.11-intelcuda-2020b.eb (partial log available at https://gist.github.com/6f3011c44318743b49d3cccf50067c9f)
• FAIL (build issue) SciPy-bundle-2021.05-foss-2021a.eb (partial log available at https://gist.github.com/d8221f071813b03ede69ab5d4b501392)
• FAIL (build issue) SciPy-bundle-2021.10-foss-2021.07.eb (partial log available at https://gist.github.com/095d36c8d66dfd8ff77fa927073968db)

Build succeeded for 2 out of 26 (26 easyconfigs in total)
cnx3 - Linux rocky linux 8.4, x86_64, Intel(R) Xeon(R) CPU E5-2667 v3 @ 3.20GHz (haswell), Python 3.6.8
See https://gist.github.com/3ce11425a72ba7cd7cda7187aac26c1c for a full test report.

[boegel]

superseded by #2862, so closing...