[Feature Request] Provide a way to build on Windows using Bazel

[terryzhao127]

Now that there is a pre-built binary of PhoenixGo on Windows, it is very kind of you to provide a way to build PhoenixGo on Windows using Bazel.

• It will be helpful for us to learn by modifying your codes.
• Now Bazel supports Windows, and the building process using Bazel is very convient compared to using Visual Studio.

[wonderingabout]

hi,

i didnt know that bazel was available for windows too, but actually : https://docs.bazel.build/versions/master/windows.html

i'm very happy with the bazel program : it is very powerful and simple to use, and after the compile it works easily
so i would also be interested in a bazel compile for windows if it is ever possible (that may also fix the avx avx2 fma avx512 issue here #74 )

however that probably requires some work to implement, but that would be a premiere in the go AI world as far as i know

@wodesuck @fiskerhuang @funionguo know better (i am only a contributor)

[terryzhao127]

Is it theoretically feasible to build PhoenixGo using current Bazel workspace on Windows? Or they should be modified to support Windows?

[wonderingabout]

@guikarist i dont know :)
we need to ask the names i mentionned in first message

but if possible, that would certainly be a great acocmplishment

[wodesuck]

I have try, but: 1. failed to use http_archive with patch parameter, 2. failed to build glog with bazel.
Need some modify for building with bazel on windows.

[terryzhao127]

@wodesuck Thanks for response. I have encountered the first problem, too. On Windows, MSYS2 is used for Bazel, so the code to run patch binary should be stripped of /usr/bin/ (the $PATH environment variable should be correctly set). I am planning to learn more about Bazel and make some modifications to Bazel files in PhoenixGo. However now I am not completely aware of what the building process of PhoenixGo really is.

[wonderingabout]

@wodesuck

yes, most likely some building settings need to be modified

but it's totally worth doing it

not only that would solve many issues, and most of all that would be a great achievement (using bazel is so easy on powerful, even a total beginner can do it, while visual studio is such a pain to use)

[wonderingabout]

@guikarist

a translation of @wodesuck comment in english using google translate (surprisingly understandable lol) :
#57 (comment)

There is trouble in compiling under Windows. .
First, you need to compile a tensorflow, see here .
Then compile glog, gflags and boost.
Then in the "Properties Manager" in Visual Studio, find the ThirdPary property, double-click to open it, find "Common Properties - User Macro", fill in the path of the above dependency.
Finally, the solution can be started.

BTW, the above operations need to be completed under Visual Studio 2015. After testing, Visual Studio 2017 can't compile tensorflow.

it may be help you figure things out

[terryzhao127]

@wonderingabout

Thanks. My colleague has done this before. But it is obviously not simple and can only support Tensorflow which is built by CMake. And Tensorflow doesn’t support CMake since 1.11.

Now I have succeeded in building libtensorflow_cc.so on Windows using Bazel which can be used after being renamed to libtensorflow_cc.dll. But other third-party lib files have .a extensions instead of .lib. There must be some problems in building Tensorflow on Windows using Bazel, too. However, I believe one day they would be solved!

[wonderingabout]

i hope too @guikarist

can you compile using visual studio 2015 rather then ?

it would be very great to have a version with :

• cuda 10.0 (already works on ubuntu, i tested it)
• cudnn 7.4.2 (same)
• supports avx avx2 fma (to cover most modern home cpu)

[terryzhao127]

@wonderingabout
It’s a pity that I have to use Visual Studio for the moment.

[wonderingabout]

@guikarist pity or not, i would appreciate if you provide a new release

the old one is so outdated and slow 😭

[terryzhao127]

@wonderingabout No problem, my colleague will do this and I will send you one as soon as he finishes.

[terryzhao127]

@wodesuck

Now Tensorflow C++ API on Windows can be built but the output files have .so or .a extensions.

The libtensorflow_cc.so file can be renamed to libtensorflow_cc.dll, and used correctly to some extent. But I have no idea how to use the built third-party files which have .a files. Do you think whether it is possible to work out a way to build PhoenixGo using Bazel with current version of Tensorflow?

[wonderingabout]

@guikarist

great !!
i cant wait really

this is the biggest highlights needed for a new windows release :

it would be very great to have a version with :

• cuda 10.0 (already works on ubuntu, i tested it)
• cudnn 7.4.2 (same)
• support for avx avx2 fma (to cover most modern home cpu)**

cuda 10.0 would support turing GPU (RTX cards), and will improve performance on Volta cards (tesla V100, titan V, etc...,), as well as improve performance on all cards

cudnn 7.4.x is significantly faster than the old cudnn 7.1.x

avx avx2 fma cpu instructions are still lacking atm, which makes the computation a lot slower

@guikarist
when your release is finished i'll test it, and if it works well i'll add it to the releases on my PR (consider sending a pull request to my branch so that you get credit for it)

https://github.com/wonderingabout/PhoenixGo/tree/faqv2-bazel-master

[wonderingabout]

@guikarist

on ubuntu bazel always downloads tensorflow 1.8

i assume PhoenixGo engine is not yet compatible with tensorflow 1.9+ (but try, maybe you can, however i would try with supported version (1.8) first :) )
@wodesuck knows better than me