Check robustness of Pkg.build when sources already present

[IainNZ]

PackageEvaluator.jl is a script that runs nightly. It attempts to load all Julia packages and run their tests (if available) on both the stable version of Julia (0.3) and the nightly build of the unstable version (0.4). The results of this script are used to generate a package listing enhanced with testing results.

On Julia 0.3

• On 2015-07-02 the testing status was Tests pass.
• On 2015-07-04 the testing status changed to Tests fail.

This issue was filed because your testing status became worse. No additional issues will be filed if your package remains in this state, and no issue will be filed if it improves. If you'd like to opt-out of these status-change messages, reply to this message saying you'd like to and @IainNZ will add an exception. If you'd like to discuss PackageEvaluator.jl please file an issue at the repository. For example, your package may be untestable on the test machine due to a dependency - an exception can be added.

Test log:

>>> 'Pkg.add("CoinOptServices")' log
INFO: Installing BinDeps v0.3.12
INFO: Installing Cbc v0.1.6
INFO: Installing Clp v0.0.9
INFO: Installing CoinOptServices v0.0.5
INFO: Installing Ipopt v0.1.15
INFO: Installing LightXML v0.1.11
INFO: Installing MathProgBase v0.3.12
INFO: Installing SHA v0.0.4
INFO: Installing URIParser v0.0.5
INFO: Building Cbc
INFO: Building Ipopt
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/downloads
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/downloads already created
INFO: Downloading file http://www.coin-or.org/download/source/Ipopt/Ipopt-3.12.1.tgz
INFO: Done downloading file http://www.coin-or.org/download/source/Ipopt/Ipopt-3.12.1.tgz
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/src
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/src already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1 already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas
INFO: Attempting to Create directory build
INFO: Directory build already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas/build
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas/build
make: *** No rule to make target `install'.  Stop.
================================[ ERROR: Ipopt ]================================

failed process: Process(`make install`, ProcessExited(2)) [2]
while loading /home/vagrant/.julia/v0.3/Ipopt/deps/build.jl, in expression starting on line 72

================================================================================
INFO: Building LightXML
INFO: Building CoinOptServices
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/downloads
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/downloads already created
INFO: Downloading file http://www.coin-or.org/download/source/OS/OS-2.9.2.tgz
INFO: Done downloading file http://www.coin-or.org/download/source/OS/OS-2.9.2.tgz
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2 already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2/build
INFO: Directory /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2/build already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/CoinOptServices/deps/src/OS-2.9.2/build
patching file OS/src/OSUtils/OSParameters.h
Reversed (or previously applied) patch detected!  Assume -R? [n] 
Apply anyway? [n] 
Skipping patch.
1 out of 1 hunk ignored -- saving rejects to file OS/src/OSUtils/OSParameters.h.rej
===========================[ ERROR: CoinOptServices ]===========================

failed process: Process(`patch -p1 -d ..`, ProcessExited(1)) [1]
while loading /home/vagrant/.julia/v0.3/CoinOptServices/deps/build.jl, in expression starting on line 71

================================================================================

================================[ BUILD ERRORS ]================================

WARNING: CoinOptServices and Ipopt had build errors.

 - packages with build errors remain installed in /home/vagrant/.julia/v0.3
 - build the package(s) and all dependencies with `Pkg.build("CoinOptServices", "Ipopt")`
 - build a single package by running its `deps/build.jl` script

================================================================================
INFO: Package database updated
INFO: METADATA is out-of-date — you may not have the latest version of CoinOptServices
INFO: Use `Pkg.update()` to get the latest versions of your packages

>>> 'Pkg.test("CoinOptServices")' log
Julia Version 0.3.10
Commit c8ceeef* (2015-06-24 13:54 UTC)
Platform Info:
  System: Linux (x86_64-unknown-linux-gnu)
  CPU: Intel(R) Xeon(R) CPU E5-2650 0 @ 2.00GHz
  WORD_SIZE: 64
  BLAS: libopenblas (USE64BITINT DYNAMIC_ARCH NO_AFFINITY Nehalem)
  LAPACK: libopenblas
  LIBM: libopenlibm
  LLVM: libLLVM-3.3
INFO: Computing test dependencies for CoinOptServices...
INFO: Installing ArrayViews v0.6.2
INFO: Installing Calculus v0.1.8
INFO: Installing DataStructures v0.3.10
INFO: Installing Docile v0.5.10
INFO: Installing DualNumbers v0.1.3
INFO: Installing FactCheck v0.2.8
INFO: Installing JuMP v0.9.2
INFO: Installing NaNMath v0.0.2
INFO: Installing ReverseDiffSparse v0.2.9
INFO: Testing CoinOptServices
ERROR: CoinOptServices not properly installed. Please run
Pkg.build("CoinOptServices")
 in error at error.jl:22
 in include at ./boot.jl:245
 in include_from_node1 at ./loading.jl:128
 in reload_path at loading.jl:152
 in _require at loading.jl:67
 in require at loading.jl:51
 in include at ./boot.jl:245
 in include_from_node1 at loading.jl:128
 in process_options at ./client.jl:285
 in _start at ./client.jl:354
while loading /home/vagrant/.julia/v0.3/CoinOptServices/src/CoinOptServices.jl, in expression starting on line 20
while loading /home/vagrant/.julia/v0.3/CoinOptServices/test/runtests.jl, in expression starting on line 1

===========================[ ERROR: CoinOptServices ]===========================

failed process: Process(`/home/vagrant/julia/bin/julia /home/vagrant/.julia/v0.3/CoinOptServices/test/runtests.jl`, ProcessExited(1)) [1]

================================================================================
INFO: Removing ArrayViews v0.6.2
INFO: Removing Calculus v0.1.8
INFO: Removing DataStructures v0.3.10
INFO: Removing Docile v0.5.10
INFO: Removing DualNumbers v0.1.3
INFO: Removing FactCheck v0.2.8
INFO: Removing JuMP v0.9.2
INFO: Removing NaNMath v0.0.2
INFO: Removing ReverseDiffSparse v0.2.9
ERROR: CoinOptServices had test errors
 in error at error.jl:21
 in test at pkg/entry.jl:718
 in anonymous at pkg/dir.jl:28
 in cd at ./file.jl:20
 in cd at pkg/dir.jl:28
 in test at pkg.jl:67
 in process_options at ./client.jl:213
 in _start at ./client.jl:354


>>> End of log

[tkelman]

Part of the message looks the same as jump-dev/Ipopt.jl#41, as if configure didn't run under Ipopt's ThirdParty/Blas/build. Can we figure out which package was first responsible for installing Ipopt and/or CoinOptServices and find its full log? There's some persistence problem with a patch file.

[IainNZ]

AmplNLWriter I think: http://pkg.julialang.org/?pkg=AmplNLWriter&ver=release

[IainNZ]

(alphabetical)

[tkelman]

Is the VM supposed to be clean before starting?

[IainNZ]

Yep, its clean

[IainNZ]

With the exception, of course, anything set up by the provisioning script

[tkelman]

If that's the case, then what's up with this?

INFO: Computing test dependencies for AmplNLWriter...
INFO: Installing BinDeps v0.3.12
INFO: Installing Cbc v0.1.6
INFO: Installing Clp v0.0.9
INFO: Installing CoinOptServices v0.0.5
INFO: Installing FactCheck v0.2.8
INFO: Installing Ipopt v0.1.15
INFO: Installing LightXML v0.1.11
INFO: Installing SHA v0.0.4
INFO: Installing URIParser v0.0.5
INFO: Building Cbc
INFO: Building Ipopt
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/downloads
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/downloads already created
INFO: Downloading file http://www.coin-or.org/download/source/Ipopt/Ipopt-3.12.1.tgz
INFO: Done downloading file http://www.coin-or.org/download/source/Ipopt/Ipopt-3.12.1.tgz
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/src
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/src already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps already created
INFO: Attempting to Create directory /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Directory /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1 already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas
INFO: Attempting to Create directory build
INFO: Directory build already created
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas/build
INFO: Changing Directory to /home/vagrant/.julia/v0.3/Ipopt/deps/src/Ipopt-3.12.1/ThirdParty/Blas/build
make: *** No rule to make target `install'.  Stop.
================================[ ERROR: Ipopt ]================================

Also note that AbstractDomains starts by uninstalling Cbc and Ipopt and a few other things. Wha?

[tkelman]

On nightly AmplNLWriter is getting terminated, probably due to a timeout.

Maybe things aren't getting cleaned like they should be?

[IainNZ]

Huh. I have a hunch, I did terminate the VMs the night before last in a weird way (i.e. killall). I'm wondering if somehow Vagrant started from there, running the provisioning script but not on a fresh virtual HDD. I'll go in there and really clear it out.

[IainNZ]

OK everything is clean now. Could leave this open until tomorrow, or just close it - up to you.

[tkelman]

If I could login to julia.mit.edu right now, I would double-check whether re-running Pkg.build when partial sources are already present can be made any more robust. I'll leave this open as a to-do, but I'm not sure whether I can do much here.

[IainNZ]

Seems fine today

[tkelman]

AmplNLWriter is still failing due to a timeout though