Add an appveyor Windows CI build. #50

moorepants · 2019-12-09T00:30:04Z

Fixes #30

moorepants · 2019-12-09T01:12:55Z

I have this: https://ci.appveyor.com/project/moorepants/cyipopt but I can't seem to get the build to trigger from this PR. Not sure why.

moorepants · 2019-12-09T01:15:23Z

@matthias-k I think this webhook https://ci.appveyor.com/api/github/webhook?id=hgg9s1eq0t051n75 needs to be added to the github webhook settings for pulls for this repo. I don't have access to the setttings for this repo.

apommel · 2019-12-09T02:03:17Z

The source link for Ipopt should rather be https://www.coin-or.org/download/binary/Ipopt/Ipopt-3.11.0-Win32-Win64-dll.7z as the one you included is not the one with DLL. There might be a way to make this one work though, but not with the current setup.

appveyor.yml

matthias-k · 2019-12-09T14:13:36Z

@matthias-k I think this webhook https://ci.appveyor.com/api/github/webhook?id=hgg9s1eq0t051n75 needs to be added to the github webhook settings for pulls for this repo. I don't have access to the setttings for this repo.

@moorepants I added the github webhook for PRs, however I'm not sure about the other settings:

should the webhook be form-encoded or JSON-encoded?
does it need a secret?

moorepants · 2019-12-09T15:49:58Z

@matthias-k It works, that is all that is needed. Thanks!

moorepants · 2019-12-09T16:44:06Z

@apommel Can you help me debug this failed import? I'm not super familiar with Windows.

appveyor.yml

apommel · 2019-12-10T07:20:10Z

appveyor.yml

+  - "%CMD_IN_ENV% python setup.py install"
+  - '%CMD_IN_ENV% python -c "import ipopt"'
+  - "%CMD_IN_ENV% python test/examplehs071.py"
+  - "%CMD_IN_ENV% python test/exception_handling.py"
+  - "%CMD_IN_ENV% python test/lasso.py"
+  - "conda.exe install --yes scipy"
+  - "%CMD_IN_ENV% python test/rosen.py"


It seemed to work better without the %CMD_IN_ENV% from looking at the AppVeyor builds

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

appveyor.yml

moorepants · 2019-12-11T08:20:55Z

Error from the Py36 build:

C:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\BIN\x86_amd64\cl.exe /c /nologo /Ox /W3 /GL /DNDEBUG /MD -IIpopt-3.11.0-Win32-Win64-dll\include\coin -IC:\Miniconda36-x64\lib\site-packages\numpy\core\include -IC:\Miniconda36-x64\include -IC:\Miniconda36-x64\include "-IC:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\INCLUDE" "-IC:\Program Files (x86)\Microsoft Visual Studio 14.0\VC\ATLMFC\INCLUDE" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\ucrt" "-IC:\Program Files (x86)\Windows Kits\NETFXSDK\4.6.1\include\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\shared" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\um" "-IC:\Program Files (x86)\Windows Kits\10\include\10.0.18362.0\winrt" /Tcsrc\cyipopt.c /Fobuild\temp.win-amd64-3.6\Release\src\cyipopt.obj
cyipopt.c
c:\miniconda36-x64\lib\site-packages\numpy\core\include\numpy\npy_1_7_deprecated_api.h(14) : Warning Msg: Using deprecated NumPy API, disable it with #define NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION
src\cyipopt.c(600): fatal error C1083: Cannot open include file: 'IpStdCInterface.h': No such file or directory
C:\Miniconda36-x64\lib\site-packages\Cython\Compiler\Main.py:369: FutureWarning: Cython directive 'language_level' not set, using 2 for now (Py2). This will change in a later release! File: C:\projects\cyipopt\src\cyipopt.pyx
  tree = Parsing.p_module(s, pxd, full_module_name)
error: command 'C:\\Program Files (x86)\\Microsoft Visual Studio 14.0\\VC\\BIN\\x86_amd64\\cl.exe' failed with exit status 2
Command exited with code 1

moorepants · 2019-12-11T08:32:59Z

Error in the Py27 build:

python -c "import ipopt"
C:\Miniconda-x64\lib\site-packages\ipopt-0.2.0.dev0-py2.7-win-amd64.egg\cyipopt.py:3: UserWarning: Module cyipopt was already imported from C:\Miniconda-x64\lib\site-packages\ipopt-0.2.0.dev0-py2.7-win-amd64.egg\cyipopt.pyc, but c:\projects\cyipopt is being added to sys.path
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "ipopt\__init__.py", line 43, in <module>
    from cyipopt import *
  File "build\bdist.win-amd64\egg\cyipopt.py", line 7, in <module>
  File "build\bdist.win-amd64\egg\cyipopt.py", line 6, in __bootstrap__
ImportError: DLL load failed: The specified module could not be found.
Command exited with code 1

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

moorepants · 2019-12-11T08:37:25Z

Here is a full build from PY27 and the attempted import that fails:

python setup.py install
running install
running bdist_egg
running egg_info
creating ipopt.egg-info
writing requirements to ipopt.egg-info\requires.txt
writing ipopt.egg-info\PKG-INFO
writing top-level names to ipopt.egg-info\top_level.txt
writing dependency_links to ipopt.egg-info\dependency_links.txt
writing manifest file 'ipopt.egg-info\SOURCES.txt'
reading manifest file 'ipopt.egg-info\SOURCES.txt'
reading manifest template 'MANIFEST.in'
warning: no files found matching '*.c' under directory 'src'
no previously-included directories found matching 'include*'
no previously-included directories found matching 'lib*'
writing manifest file 'ipopt.egg-info\SOURCES.txt'
installing library code to build\bdist.win-amd64\egg
running install_lib
running build_py
creating build
creating build\lib.win-amd64-2.7
creating build\lib.win-amd64-2.7\ipopt
copying ipopt\ipopt_wrapper.py -> build\lib.win-amd64-2.7\ipopt
copying ipopt\version.py -> build\lib.win-amd64-2.7\ipopt
copying ipopt\__init__.py -> build\lib.win-amd64-2.7\ipopt
running build_ext
cythoning src/cyipopt.pyx to src\cyipopt.c
building 'cyipopt' extension
creating build\temp.win-amd64-2.7
creating build\temp.win-amd64-2.7\Release
creating build\temp.win-amd64-2.7\Release\src
C:\Users\appveyor\AppData\Local\Programs\Common\Microsoft\Visual C++ for Python\9.0\VC\Bin\amd64\cl.exe /c /nologo /Ox /MD /W3 /GS- /DNDEBUG -IC:\projects\cyipopt\include\coin -IC:\Miniconda-x64\lib\site-packages\numpy\core\include -IC:\Miniconda-x64\include -IC:\Miniconda-x64\PC /Tcsrc\cyipopt.c /Fobuild\temp.win-amd64-2.7\Release\src\cyipopt.obj
cyipopt.c
c:\miniconda-x64\lib\site-packages\numpy\core\include\numpy\npy_1_7_deprecated_api.h(12) : Warning Msg: Using deprecated NumPy API, disable it by #defining NPY_NO_DEPRECATED_API NPY_1_7_API_VERSION
src\cyipopt.c(3887) : warning C4244: '=' : conversion from 'Py_ssize_t' to 'Index', possible loss of data
src\cyipopt.c(3945) : warning C4244: '=' : conversion from 'Py_ssize_t' to 'Index', possible loss of data
C:\Users\appveyor\AppData\Local\Programs\Common\Microsoft\Visual C++ for Python\9.0\VC\Bin\amd64\link.exe /DLL /nologo /INCREMENTAL:NO /LIBPATH:C:\projects\cyipopt\lib\x64\ReleaseMKL /LIBPATH:C:\Miniconda-x64\libs /LIBPATH:C:\Miniconda-x64\PCbuild\amd64 /LIBPATH:C:\Miniconda-x64\PC\VS9.0\amd64 Ipopt-vc8.lib IpOptFSS.lib IpOpt-vc10.lib /EXPORT:initcyipopt build\temp.win-amd64-2.7\Release\src\cyipopt.obj /OUT:build\lib.win-amd64-2.7\cyipopt.pyd /IMPLIB:build\temp.win-amd64-2.7\Release\src\cyipopt.lib /MANIFESTFILE:build\temp.win-amd64-2.7\Release\src\cyipopt.pyd.manifest
cyipopt.obj : warning LNK4197: export 'initcyipopt' specified multiple times; using first specification
   Creating library build\temp.win-amd64-2.7\Release\src\cyipopt.lib and object build\temp.win-amd64-2.7\Release\src\cyipopt.exp
creating build\bdist.win-amd64
creating build\bdist.win-amd64\egg
copying build\lib.win-amd64-2.7\cyipopt.pyd -> build\bdist.win-amd64\egg
creating build\bdist.win-amd64\egg\ipopt
copying build\lib.win-amd64-2.7\ipopt\ipopt_wrapper.py -> build\bdist.win-amd64\egg\ipopt
copying build\lib.win-amd64-2.7\ipopt\version.py -> build\bdist.win-amd64\egg\ipopt
copying build\lib.win-amd64-2.7\ipopt\__init__.py -> build\bdist.win-amd64\egg\ipopt
byte-compiling build\bdist.win-amd64\egg\ipopt\ipopt_wrapper.py to ipopt_wrapper.pyc
byte-compiling build\bdist.win-amd64\egg\ipopt\version.py to version.pyc
byte-compiling build\bdist.win-amd64\egg\ipopt\__init__.py to __init__.pyc
creating stub loader for cyipopt.pyd
byte-compiling build\bdist.win-amd64\egg\cyipopt.py to cyipopt.pyc
installing package data to build\bdist.win-amd64\egg
running install_data
copying C:\projects\cyipopt\lib\x64\ReleaseMKL\IpOptFSS.dll -> build\bdist.win-amd64\egg\
copying C:\projects\cyipopt\lib\x64\ReleaseMKL\Ipopt-vc8.dll -> build\bdist.win-amd64\egg\
copying C:\projects\cyipopt\lib\x64\ReleaseMKL\IpOpt-vc10.dll -> build\bdist.win-amd64\egg\
copying C:\projects\cyipopt\lib\x64\ReleaseMKL\libiomp5md.dll -> build\bdist.win-amd64\egg\
copying C:\projects\cyipopt\lib\x64\ReleaseMKL\msvcp100.dll -> build\bdist.win-amd64\egg\
copying C:\projects\cyipopt\lib\x64\ReleaseMKL\msvcr100.dll -> build\bdist.win-amd64\egg\
creating build\bdist.win-amd64\egg\EGG-INFO
copying ipopt.egg-info\PKG-INFO -> build\bdist.win-amd64\egg\EGG-INFO
copying ipopt.egg-info\SOURCES.txt -> build\bdist.win-amd64\egg\EGG-INFO
copying ipopt.egg-info\dependency_links.txt -> build\bdist.win-amd64\egg\EGG-INFO
copying ipopt.egg-info\requires.txt -> build\bdist.win-amd64\egg\EGG-INFO
copying ipopt.egg-info\top_level.txt -> build\bdist.win-amd64\egg\EGG-INFO
writing build\bdist.win-amd64\egg\EGG-INFO\native_libs.txt
C:\Miniconda-x64\lib\site-packages\Cython\Compiler\Main.py:369: FutureWarning: Cython directive 'language_level' not set, using 2 for now (Py2). This will change in a later release! File: C:\projects\cyipopt\src\cyipopt.pyx
  tree = Parsing.p_module(s, pxd, full_module_name)
zip_safe flag not set; analyzing archive contents...
creating dist
creating 'dist\ipopt-0.2.0.dev0-py2.7-win-amd64.egg' and adding 'build\bdist.win-amd64\egg' to it
removing 'build\bdist.win-amd64\egg' (and everything under it)
Processing ipopt-0.2.0.dev0-py2.7-win-amd64.egg
Copying ipopt-0.2.0.dev0-py2.7-win-amd64.egg to c:\miniconda-x64\lib\site-packages
Adding ipopt 0.2.0.dev0 to easy-install.pth file
Installed c:\miniconda-x64\lib\site-packages\ipopt-0.2.0.dev0-py2.7-win-amd64.egg
Processing dependencies for ipopt==0.2.0.dev0
Searching for setuptools==42.0.2.post20191201
Best match: setuptools 42.0.2.post20191201
Adding setuptools 42.0.2.post20191201 to easy-install.pth file
Installing easy_install-script.py script to C:\Miniconda-x64\Scripts
Installing easy_install.exe script to C:\Miniconda-x64\Scripts
Using c:\miniconda-x64\lib\site-packages
Searching for future==0.18.2
Best match: future 0.18.2
Adding future 0.18.2 to easy-install.pth file
Installing pasteurize-script.py script to C:\Miniconda-x64\Scripts
Installing pasteurize.exe script to C:\Miniconda-x64\Scripts
Installing futurize-script.py script to C:\Miniconda-x64\Scripts
Installing futurize.exe script to C:\Miniconda-x64\Scripts
Using c:\miniconda-x64\lib\site-packages
Searching for six==1.13.0
Best match: six 1.13.0
Adding six 1.13.0 to easy-install.pth file
Using c:\miniconda-x64\lib\site-packages
Searching for Cython==0.29.14
Best match: Cython 0.29.14
Adding Cython 0.29.14 to easy-install.pth file
Installing cython-script.py script to C:\Miniconda-x64\Scripts
Installing cython.exe script to C:\Miniconda-x64\Scripts
Installing cygdb-script.py script to C:\Miniconda-x64\Scripts
Installing cygdb.exe script to C:\Miniconda-x64\Scripts
Installing cythonize-script.py script to C:\Miniconda-x64\Scripts
Installing cythonize.exe script to C:\Miniconda-x64\Scripts
Using c:\miniconda-x64\lib\site-packages
Searching for numpy==1.15.4
Best match: numpy 1.15.4
Adding numpy 1.15.4 to easy-install.pth file
Using c:\miniconda-x64\lib\site-packages
Finished processing dependencies for ipopt==0.2.0.dev0
python -c "import ipopt"
C:\Miniconda-x64\lib\site-packages\ipopt-0.2.0.dev0-py2.7-win-amd64.egg\cyipopt.py:3: UserWarning: Module cyipopt was already imported from C:\Miniconda-x64\lib\site-packages\ipopt-0.2.0.dev0-py2.7-win-amd64.egg\cyipopt.pyc, but c:\projects\cyipopt is being added to sys.path
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "ipopt\__init__.py", line 43, in <module>
    from cyipopt import *
  File "build\bdist.win-amd64\egg\cyipopt.py", line 7, in <module>
  File "build\bdist.win-amd64\egg\cyipopt.py", line 6, in __bootstrap__
ImportError: DLL load failed: The specified module could not be found.
Command exited with code 1

moorepants · 2019-12-11T08:44:59Z

For the MKL error in the PY36 build this may be helpful: https://conda.io/projects/conda/en/latest/user-guide/troubleshooting.html#numpy-mkl-library-load-failed

apommel · 2019-12-11T14:30:31Z

python -c "import ipopt"
C:\Miniconda-x64\lib\site-packages\ipopt-0.2.0.dev0-py2.7-win-amd64.egg\cyipopt.py:3: UserWarning: Module cyipopt was already imported from C:\Miniconda-x64\lib\site-packages\ipopt-0.2.0.dev0-py2.7-win-amd64.egg\cyipopt.pyc, but c:\projects\cyipopt is being added to sys.path
Traceback (most recent call last):
  File "<string>", line 1, in <module>
  File "ipopt\__init__.py", line 43, in <module>
    from cyipopt import *
  File "build\bdist.win-amd64\egg\cyipopt.py", line 7, in <module>
  File "build\bdist.win-amd64\egg\cyipopt.py", line 6, in __bootstrap__
ImportError: DLL load failed: The specified module could not be found.
Command exited with code 1

Actually, I also get an error on my current working cyipopt installation (with Python 3.7). The message is different though:

INTEL MKL ERROR: The operating system cannot run %1. mkl_intel_thread.dll.
Intel MKL FATAL ERROR: Cannot load mkl_intel_thread.dll.

I remember that on the previous PR, this line was at some point also failing on Travis even though the import was when working correctly within the test files (see job 64). I wonder why this behaves differently here.
Could you try omitting this line just to see if it does the same thing on the test scripts?

moorepants · 2019-12-11T14:32:04Z

That same error is present on the py36 and py37 builds I believe.

moorepants · 2019-12-11T14:45:07Z

py36 and py37 passed when the import test was skipped. That's positive.

apommel · 2019-12-11T15:07:30Z

I thought the issue had to do with activating the environment, but even after dealing with that the issue is still there on my side concerning the import from the command line. It seems to be a weird bug from windows as it can import from files.

Concerning Python 2.7, it seems like the DLL are not loaded for some reason. I will try to test it myself tomorrow to see if it's a Python 2.7 problem or if it comes from AppVeyor. As for 3.5, well I don't know, this part seems to work without issues on the other versions.

apommel · 2019-12-11T15:29:34Z

On Python 2.7, the setup seems to only produce an egg file ipopt-0.2.0.dev0-py2.7-win-amd64.egg. The DLL are packaged inside, but I guess that's what must cause problems in some way.

setup.py

apommel · 2019-12-12T11:33:35Z

Even better solution: adding the flag zip_safe=False in setup in setup.py. This way, the module is still properly packaged without being zipped, so the DLL are working properly on Python 2.7. The installation can be done with python setup.py install.

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

appveyor.yml

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

moorepants · 2019-12-14T14:04:50Z

All green! Thanks @apommel for the help!

First stab at an appveyor config file.

2876790

moorepants closed this Dec 9, 2019

moorepants reopened this Dec 9, 2019

moorepants closed this Dec 9, 2019

moorepants reopened this Dec 9, 2019

moorepants commented Dec 9, 2019

View reviewed changes

appveyor.yml Outdated Show resolved Hide resolved

moorepants commented Dec 9, 2019

View reviewed changes

appveyor.yml Outdated Show resolved Hide resolved

moorepants commented Dec 9, 2019

View reviewed changes

appveyor.yml Outdated Show resolved Hide resolved

moorepants closed this Dec 9, 2019

moorepants reopened this Dec 9, 2019

moorepants added 3 commits December 9, 2019 08:19

Try different download technique and correct ipopt file.

4d49ddc

Add extract to 7z command.

0bf3c4d

Remove CMD_IN_ENV.

8bceaa4

This comment has been minimized.

Sign in to view

moorepants commented Dec 9, 2019

View reviewed changes

appveyor.yml Show resolved Hide resolved

moorepants added 2 commits December 9, 2019 09:08

Introduced an env var to point to IPOPT on windows.

62397e2

Added back the CMD_IN_ENV.

8d91ae7

apommel reviewed Dec 10, 2019

View reviewed changes

appveyor.yml Outdated Show resolved Hide resolved

apommel reviewed Dec 10, 2019

View reviewed changes

appveyor.yml Outdated Show resolved Hide resolved

apommel reviewed Dec 10, 2019

View reviewed changes

moorepants and others added 2 commits December 10, 2019 22:36

Update appveyor.yml

47e44cd

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

Update appveyor.yml

0480af3

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

apommel reviewed Dec 11, 2019

View reviewed changes

appveyor.yml Outdated Show resolved Hide resolved

Remove CMD_IN_ENV again.

e456bde

moorepants added 3 commits December 11, 2019 00:22

Add ls to check on 7z file.

b003cfc

7z unzips into the current directory.

e7357b3

Fix escape chars.

58ee01b

Update appveyor.yml

11379ec

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

Skip the import test.

2f986ab

apommel reviewed Dec 12, 2019

View reviewed changes

setup.py Outdated Show resolved Hide resolved

This comment has been minimized.

Sign in to view

Update setup.py

df46b5c

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

moorepants commented Dec 12, 2019

View reviewed changes

appveyor.yml Outdated Show resolved Hide resolved

Update appveyor.yml

90d9cd5

apommel reviewed Dec 13, 2019

View reviewed changes

appveyor.yml Show resolved Hide resolved

moorepants and others added 2 commits December 13, 2019 20:13

Update appveyor.yml

7523ec8

Co-Authored-By: Aurélien Pommel <46231231+apommel@users.noreply.github.com>

Added zip_safe=False in setup.py.

de25818

moorepants added 2 commits December 14, 2019 06:50

Tidying up and adding windows install instructions to the README.

287ab0d

Change env var to be IPOPTWINDIR.

eca7994

This was referenced Dec 14, 2019

Cannot install #46

Closed

windows installation dll file not recognized #45

Closed

moorepants merged commit 8065634 into mechmotum:master Dec 14, 2019

moorepants deleted the appveyor branch December 14, 2019 15:19

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Add an appveyor Windows CI build. #50

Add an appveyor Windows CI build. #50

moorepants commented Dec 9, 2019 •

edited

Loading

moorepants commented Dec 9, 2019

moorepants commented Dec 9, 2019

apommel commented Dec 9, 2019

matthias-k commented Dec 9, 2019

moorepants commented Dec 9, 2019

This comment has been minimized.

moorepants commented Dec 9, 2019

apommel Dec 10, 2019

moorepants commented Dec 11, 2019

moorepants commented Dec 11, 2019

moorepants commented Dec 11, 2019

moorepants commented Dec 11, 2019

apommel commented Dec 11, 2019

moorepants commented Dec 11, 2019

moorepants commented Dec 11, 2019

apommel commented Dec 11, 2019

apommel commented Dec 11, 2019

This comment has been minimized.

apommel commented Dec 12, 2019

moorepants commented Dec 14, 2019

Add an appveyor Windows CI build. #50

Add an appveyor Windows CI build. #50

Conversation

moorepants commented Dec 9, 2019 • edited Loading

moorepants commented Dec 9, 2019

moorepants commented Dec 9, 2019

apommel commented Dec 9, 2019

matthias-k commented Dec 9, 2019

moorepants commented Dec 9, 2019

This comment has been minimized.

moorepants commented Dec 9, 2019

apommel Dec 10, 2019

Choose a reason for hiding this comment

moorepants commented Dec 11, 2019

moorepants commented Dec 11, 2019

moorepants commented Dec 11, 2019

moorepants commented Dec 11, 2019

apommel commented Dec 11, 2019

moorepants commented Dec 11, 2019

moorepants commented Dec 11, 2019

apommel commented Dec 11, 2019

apommel commented Dec 11, 2019

This comment has been minimized.

apommel commented Dec 12, 2019

moorepants commented Dec 14, 2019

moorepants commented Dec 9, 2019 •

edited

Loading