Skip to content

Latest commit

 

History

History
1047 lines (813 loc) · 45.2 KB

INSTALL-WIN32.md

File metadata and controls

1047 lines (813 loc) · 45.2 KB
Raw

How to Build Erlang/OTP on Windows

Introduction

This file describes how to build the Erlang emulator and the OTP libraries on Windows. The instructions apply to versions of Windows supporting the Cygwin emulated gnuish environment for Windows or the Msys ditto. We've built on the following platforms: Windows 2003 server, Windows XP Home/Professional, Windows Vista and Windows 7 (32 and 64 bit). You can probably build on Windows 2000, but you will not be able to install the latest Microsoft SDK, so you have to go back to some earlier compiler. Any Windows95'ish platform will surely get you into trouble, what I'm not sure of, but it certainly will...

The procedure described uses either Cygwin or Msys as a build environment, you run the bash shell in Cygwin/Msys and use gnu make/configure/autoconf etc to do the build. The emulator C-source code is, however, mostly compiled with Microsoft Visual C++™, producing a native Windows binary. This is the same procedure as we use to build the pre-built binaries. The fact that we use VC++ and not gcc is explained further in the FAQ section.

I describe the build procedure to make it possible for open source customers to build the emulator, given that they have the needed tools. The binary Windows releases is still a preferred alternative if one does not have Microsoft's development tools and/or don't want to install Cygwin or Msys.

To use Cygwin/Msys, one needs basic experience from a Unix environment, if one does not know how to set environment variables, run programs etc in a Unix environment, one will be quite lost in the Cygwin os Msys ditto. I can unfortunately not teach all the world how to use Cygwin and bash, neither how to install Cygwin nor perform basic tasks on a computer. Please refer to other documentation on the net for help, or use the binary release instead if you have problems using the tools.

However, if you feel comfortable with the environment and build system, and have all the necessary tools, you have a great opportunity to make the Erlang/OTP distribution for Windows better. Please submit any suggestions and patches to the appropriate [mailing lists] 1 to let them find their way into the next version of Erlang. If making changes to the build system (like makefiles etc) please bear in mind that the same makefiles are used on Unix/VxWorks, so that your changes don't break other platforms. That of course goes for C-code too, system specific code resides in the $ERL_TOP/erts/emulator/sys/win32 and $ERL_TOP/erts/etc/win32 directories mostly. The $ERL_TOP/erts/emulator/beam directory is for common code.

Before the R9C release of Erlang/OTP, the Windows release was built partly on a Unix (Solaris) box and partly on a Windows box, using Perl hacks to communicate and sync between the two machines. R9C was the first release ever built solely on Windows, where no Unix machine is needed at all. Now we've used this build procedure for a couple of releases, and it has worked fine for us. Still, there might be all sorts of troubles on different machines and with different setups. I'll try to give hints wherever I've encountered difficulties, but please share your experiences by using the [erlang-questions] 1 mailing list. I cannot of course help everyone with all their problems, please try to solve the problems and submit solutions/workarounds. Remember, it's all about sharing, not about demanding...

Starting with R15B, our build system runs both on Cygwin and Msys (MinGW's fork of an early cygwin version). Msys is a smaller package to install and may on some machines run slightly faster. If Cygwin gives you trouble, try Msys instead, and v.v. Beginning with R15B there is also a native 64bit version of Erlang for 64bit Windows 7 (only). These instructions apply to both the 32bit VM and the 64bit ditto.

Note that even if you build a 64bit VM, most of the directories and files involved are still named win32. You can view the name win32 as meaning any windows version not beeing 16bit. A few occurences of the name Win64 are however present in the system, for example the installation file for a 64 bit windows version of Erlang is by default named otp_win64_<version>.exe.

Lets go then, I'll start with a little FAQ, based on in house questions and misunderstandings.

Frequently Asked Questions

  • Q: So, now I can build Erlang using GCC on Windows?

    A: No, unfortunately not. You'll need Microsoft's Visual C++ still, a Bourne-shell script (cc.sh) wraps the Visual C++ compiler and runs it from within the Cygwin environment. All other tools needed to build Erlang are free-ware/open source, but not the C compiler. The Windows SDK is however enough to build Erlang, you do not need to buy Visual C++, just download the SDK (SDK version 7.1 == Visual studio 2010).

  • Q: Why haven't you got rid of VC++ then, you ******?

    A: Well, partly because it's a good compiler - really! Actually it's been possible in late R11-releases to build using mingw instead of visual C++ (you might see the remnants of that in some scripts and directories). Unfortunately the development of the SMP version for Windows broke the mingw build and we chose to focus on the VC++ build as the performance has been much better in the VC++ versions. The mingw build will possibly be back, but as long as VC++ gives better performance, the commercial build will be a VC++ one.

  • Q: OK, you need VC++, but now you've started to demand a very recent (and expensive) version of Visual studio, not the old and stable VC++ 6.0 that was used in earlier versions. Why?

    A: Well, it's not expensive, it's free (as in free beer). Just download and install the latest Windows SDK from Microsoft and all the tools you need are there. The included debugger (WinDbg) is also quite usable, it's what I used when porting Erlang to 64bit Windows. Another reason to use the latest Microsoft compilers is DLL compatibility. DLL's using a new version of the standard library might not load if the VM is compiled with an old VC++ version, why we should aim to use the latest freely available SDK and compiler.

  • Q: Can/will I build a Cygwin binary with the procedure you describe?

    A: No, the result will be a pure Windows binary, and as far as I know, it's not possible to make a Cygwin binary yet. That is of course something desirable, but there are still some problems with the dynamic linking (dynamic Erlang driver loading) as well as the TCP/IP emulation in Cygwin, which, I'm sure of, will improve, but still has some problems. Fixing those problems might be easy or might be hard. I suggest you try yourself and share your experience. No one would be happier if a simple ./configure && make would produce a fully fledged Cygwin binary. Ericsson does however not pay me to do a Cygwin port, so such a port would have to happen in spare time, which is a limited resource...

  • Q: Hah, I saw you, you used GCC even though you said you didn't!

    A: OK, I admit, one of the files is compiled using Cygwin's or MinGW's GCC and the resulting object code is then converted to MS VC++ compatible coff using a small C hack. It's because that particular file, beam_emu.c benefits immensely from being able to use the GCC labels-as-values extension, which boosts emulator performance by up to 50%. That does unfortunately not (yet) mean that all of OTP could be compiled using GCC, that particular source code does not do anything system specific and actually is adopted to the fact that GCC is used to compile it on Windows.

  • Q: So now there's a MS VC++ project file somewhere and I can build OTP using the nifty VC++ GUI?

    A: No, never. The hassle of keeping the project files up to date and do all the steps that constitute an OTP build from within the VC++ GUI is simply not worth it, maybe even impossible. A VC++ project file for Erlang/OTP will never happen, at least I will never make one. Clicking around in super-multi-tab'd dialogs to add a file or compiler option when it's so much easier in a makefile is simply not my style.

  • Q: So how does it all work then?

    A: Cygwin or Msys is the environment, which closely resembles the environments found on any Unix machine. It's almost like you had a virtual Unix machine inside Windows. Configure, given certain parameters, then creates makefiles that are used by the Cygwin/Msys gnu-make to built the system. Most of the actual compilers etc are not, however, Cygwin/Msys tools, so I've written a couple of wrappers (Bourne-shell scripts), which reside in $ERL_TOP/etc/win32/cygwin_tools and $ERL_TOP/etc/win32/msys_tools. They all do conversion of parameters and switches common in the Unix environment to fit the native Windows tools. Most notable is of course the paths, which in Cygwin/Msys are Unix-like paths with "forward slashes" (/) and no drive letters, the Cygwin specific command cygpath is used for most of the path conversions in a Cygwin environment, other tools are used (when needed) in the corresponding Msys environment. Luckily most compilers accept forward slashes instead of backslashes as path separators, but one still have to get the drive letters etc right, though. The wrapper scripts are not general in the sense that, for example, cc.sh would understand and translates every possible gcc option and passes correct options to cl.exe. The principle is that the scripts are powerful enough to allow building of Erlang/OTP, no more, no less. They might need extensions to cope with changes during the development of Erlang, that's one of the reasons I made them into shell-scripts and not Perl-scripts, I believe they are easier to understand and change that way. I might be wrong though, cause another reason I didn't write them in Perl is because I've never liked Perl and my Perl code is no pleasant reading...

    In $ERL_TOP, there is a script called otp_build. That script handles the hassle of giving all the right parameters to configure/make and also helps you set up the correct environment variables to work with the Erlang source under Cygwin.

  • Q: You use and need Cygwin, but then you haven't taken the time to port Erlang to the Cygwin environment but instead focus on your commercial release, is that really ethical?

    A: No, not really, but see this as a step in the right direction. I'm aiming at GCC compiled emulators and a Cygwin version, but I really need to do other things as well... In time, but don't hold your breath...

  • Q: Can I build something that looks exactly as the commercial release?

    A: Yes, we use the exactly same build procedure.

  • Q: Which version of Cygwin/Msys and other tools do you use then?

    A: For Cygwin and Msys alike, we try to use the latest releases available when building. What versions you use shouldn't really matter, I try to include workarounds for the bugs I've found in different Cygwin/Msys releases, please help me add workarounds for new Cygwin/Msys-related bugs as soon as you encounter them. Also please do submit bug reports to the appropriate Cygwin and/or Msys developers. The GCC we used for %OTP-REL% was version 4.7.0 (MinGW 64bit) and 4.3.4 (Cygwin 32bit). We used VC++ 10.0 (i.e. Visual studio 2010), Sun's JDK 1.5.0_17 (32bit) and Sun's JDK 1.7.0_1 (64bit), NSIS 2.46, and Win32 OpenSSL 0.9.8r. Please read the next section for details on what you need.

  • Q: Can you help me setup X in Cygwin?

    A: No, unfortunately I haven't got time to help with Cygwin related user problems, please read Cygwin related web sites, newsgroups and mailing lists.

  • Q: Why is the instruction so long? Is it really that complicated?

    A: Partly it's long because I babble too much, partly because I've described as much as I could about the installation of the needed tools. Once the tools are installed, building is quite easy. I also have tried to make this instruction understandable for people with limited Unix experience. Cygwin/Msys is a whole new environment to some Windows users, why careful explanation of environment variables etc seemed to be in place. The short story, for the experienced and impatient is:

    • Get and install complete Cygwin (latest) or complete MinGW with msys

    • Install Microsofts Windows SDK 7.1 (and .Net 4)

    • Get and install Sun's JDK 1.5.0 or higher

    • Get and install NSIS 2.01 or higher (up to 2.46 tried and working)

    • Get, build and install OpenSSL 0.9.8r or higher (up to 1.0.0a tried & working) with static libs.

    • Get the Erlang source distribution (from http://www.erlang.org/download.html) and unpack with Cygwin's tar.

    • Set ERL_TOP to where you unpacked the source distribution

    • $ cd $ERL_TOP

    • Get (from http://www.erlang.org/download/tcltk85_win32_bin.tar.gz) and unpack the prebuilt TCL/TK binaries for windows with cygwin tar, standing in $ERL_TOP

    • Modify PATH and other environment variables so that all these tools are runnable from a bash shell. Still standing in $ERL_TOP, issue the following commands:

      $ eval `./otp_build env_win32`
$ ./otp_build autoconf
$ ./otp_build configure
$ ./otp_build boot -a
$ ./otp_build release -a
$ ./otp_build installer_win32
$ release/win32/otp_win32_%OTP-REL% /S

    Voila! Start->Programs->Erlang OTP %OTP-REL%->Erlang starts the Erlang Windows shell.

Tools you Need and Their Environment

You need some tools to be able to build Erlang/OTP on Windows. Most notably you'll need Cygwin or Msys and Microsofts Windows SDK, but you also might want a Java compiler, the NSIS install system and OpenSSL. Well' here's the list:

  • Cygwin, the very latest is usually best. Get all the development tools and of course all the basic ditto. In fact getting the complete package might be a good idea, as you'll start to love Cygwin after a while if you're accustomed to Unix. Make sure to get jar and also make sure not to install a Cygwin'ish Java... The Cygwin jar command is used but Sun's Java compiler and virtual machine...

    If you are going to build a 64bit Windows version, you should make sure to get MinGW's 64bit gcc installed with cygwin. It's in one of the development packages.

    URL: http://www.cygwin.com

    Get the installer from the web site and use that to install Cygwin. Be sure to have fair privileges. If you're on a NT domain you should consider running mkpasswd -d and mkgroup -d after the installation to get the user databases correct. See their respective manual pages.

    When you start you first bash shell, you will get an awful prompt. You might also have a PATH environment variable that contains backslashes and such. Edit $HOME/.profile and $HOME/.bashrc to set fair prompts and set a correct PATH. Also do a export SHELL in .profile. For some non-obvious reason the environment variable $SHELL is not exported in bash. Also note that .profile is run at login time and .bashrc when sub shells are created. You'll need to explicitly source .bashrc from .profile if you want the commands there to be run at login time (like setting up aliases, shell functions and the like). I personally usually do like this at the end of .profile:

    ENV=$HOME/.bashrc
export ENV
. $ENV

    You might also, if you're a hard core type of person at least, want to setup X-windows (XFree86), that might be as easy as running startx from the command prompt and it might be much harder. Use Google to find help...

    If you don't use X-windows, you might want to setup the Windows console window by selecting properties in the console system menu (upper left corner of the window, the Cygwin icon in the title bar). Especially setting a larger screen buffer size (lines) is useful as it gets you a scrollbar so you can see whatever error messages that might appear...

    If you want to use (t)csh instead of bash you're on your own, I haven't tried and know of no one that has. I expect that you use bash in all shell examples.

  • Alternatively you download MinGW and Msys. You'll find the latest installer at:

    URL: http://sourceforge.net/projects/mingw/files/Installer/mingw-get-inst/

    Make sure to install everything they've got.

    To be able to build the 64bit VM, you will also need the 64bit MinGW compiler from:

    URL: http://sourceforge.net/projects/mingw-w64/files/Toolchains%20targetting%20Win64/Automated%20Builds/

    The latest version should do it. Make sure you download the mingw-w64-bin_i686-mingw_<something>.zip, not a linux version. You unzip the package on top of your MinGW installation (c:\MinGW) and that's it.

    Setting up your environment in Msys is similar to setting it up in Cygwin.

  • Microsofts Windows SDK version 7.1 (corresponding to VC++ 10.0 and Visual Studio 2010). You'll find it here:

    URL: http://www.microsoft.com/download/en/details.aspx?id=8279

    but before you install that, you need to have .Net 4 installed, you'll find that here:

    URL: http://www.microsoft.com/download/en/details.aspx?id=17851

    Use the web installer for the SDK, at least when I tried downloading the whole package as an image, I got SDK 7.0 instead, which is not what you want...

    There will be a Windows command file in %PROGRAMFILES%\Mirosoft SDKs\Windows\v7.1\Bin\SetEnv.cmd that set's the appropriate environment for a Windows command prompt. This is not appropriate for bash, so you'll need to convert it to bash-style environments by editing your .bash_profile. In my case, where the SDK is installed in the default directory and %PROGRAMFILES% is C:\Program Files, the commands for setting up a 32bit build environment (on a 64bit or 32bit machine) look like this (in cygwin):

      # Some common paths
  C_DRV=/cygdrive/c
  PRG_FLS=$C_DRV/Program\ Files

  # nsis
  NSIS_BIN=$PRG_FLS/NSIS
  # java
  JAVA_BIN=$PRG_FLS/Java/jdk1.6.0_16/bin

  ##
  ## MS SDK
  ##

  CYGWIN=nowinsymlinks
  MVS10="$PRG_FILES/Microsoft Visual Studio 10.0"
  WIN_MVS10="C:\\Program Files\\Microsoft Visual Studio 10.0"
  SDK10="$PRG_FILES/Microsoft SDKs/Windows/v7.1"
  WIN_SDK10="C:\\Program Files\\Microsoft SDKs\\Windows\\v7.1"

  PATH="$NSIS_BIN:\
  $MVS10/Common7/IDE:\
  $MVS10/Common7/Tools:\
  $MVS10/VC/Bin:\
  $MVS10/VC/Bin/VCPackages:\
  $SDK10/Bin/NETFX 4.0 Tools:\
  $SDK10/Bin:\
  /usr/local/bin:/usr/bin:/bin:\
  /cygdrive/c/WINDOWS/system32:/cygdrive/c/WINDOWS:\
  /cygdrive/c/WINDOWS/system32/Wbem:\
  $JAVA_BIN"

  LIBPATH="$WIN_MVS10\\VC\\LIB"

  LIB="$WIN_MVS10\\VC\\LIB;$WIN_SDK10\\LIB"

  INCLUDE="$WIN_MVS10\\VC\\INCLUDE;$WIN_SDK10\\INCLUDE;$WIN_SDK10\\INCLUDE\\gl"

  export CYGWIN PATH LIBPATH LIB INCLUDE

    If you're using Msys instead, the only thing you need to change is the C_DRV setting, which would read:

      C_DRV=/c

    And of course you might need to change C:\Program Files etc if you're using a non-english version of Windows (XP). Note that in later versions of Windows, the national adoptions of the program files directories etc are not on the file system but only in the explorer, so even if explorer says that your programs reside in e.g. C:\Program, they might still reside in C:\Program Files in reality...

    If you are building a 64 bit version of Erlang, you should set up PATHs etc a little differently. I use the following script to make things work in both Cygwin and Msys:

       make_winpath()
   {
          P=$1
          if [ "$IN_CYGWIN" = "true" ]; then 
             cygpath -d "$P"
          else
             (cd "$P" && /bin/cmd //C "for %i in (".") do @echo %~fsi")
          fi
   }

   make_upath()
   {
          P=$1
          if [ "$IN_CYGWIN" = "true" ]; then 
             cygpath "$P"
          else
             echo "$P" | /bin/sed 's,^\([a-zA-Z]\):\\,/\L\1/,;s,\\,/,g'
          fi
   }

   # Some common paths
   if [ -x /usr/bin/msysinfo ]; then
      # Without this the path conversion won't work
      COMSPEC='C:\Windows\SysWOW64\cmd.exe'
      MSYSTEM=MINGW32
      export MSYSTEM COMSPEC
      IN_CYGWIN=false
   else
      CYGWIN=nowinsymlinks
      export CYGWIN
      IN_CYGWIN=true
   fi

   if [ "$IN_CYGWIN" = "true" ]; then 
      PATH=/usr/local/bin:/usr/bin:/bin:/usr/X11R6/bin:\
      /cygdrive/c/windows/system32:/cygdrive/c/windows:/cygdrive/c/windows/system32/Wbem
   else
      PATH=/usr/local/bin:/mingw/bin:/bin:/c/Windows/system32:/c/Windows:\
      /c/Windows/System32/Wbem
   fi

   if [ "$IN_CYGWIN" = "true" ]; then 
      C_DRV=/cygdrive/c
   else
      C_DRV=/c
   fi

   PRG_FLS64=$C_DRV/Program\ Files
   PRG_FLS32=$C_DRV/Program\ Files\ \(x86\)
   VISUAL_STUDIO_ROOT32=$PRG_FLS32/Microsoft\ Visual\ Studio\ 10.0
   MS_SDK_ROOT64=$PRG_FLS64/Microsoft\ SDKs/Windows/v7.1

   # Okay, now mangle the paths and get rid of spaces by using short names
   WIN_VCROOT32=`make_winpath "$VISUAL_STUDIO_ROOT32"`
   VCROOT32=`make_upath $WIN_VCROOT32`
   WIN_SDKROOT64=`make_winpath "$MS_SDK_ROOT64"`
   SDKROOT64=`make_upath $WIN_SDKROOT64`
   WIN_PROGRAMFILES32=`make_winpath "$PRG_FLS32"`
   PROGRAMFILES32=`make_upath $WIN_PROGRAMFILES32`

   WIN_PROGRAMFILES64=`make_winpath "$PRG_FLS64"`
   PROGRAMFILES64=`make_upath $WIN_PROGRAMFILES64`

   # nsis
   NSIS_BIN=$PROGRAMFILES32/NSIS
   # java
   JAVA_BIN=$PROGRAMFILES64/Java/jdk1.7.0_01/bin

   ## The PATH variable should be Unix'ish
   VCPATH=$VCROOT32/Common7/IDE:$VCROOT32/VC/BIN/amd64:$VCROOT32/Common7/Tools:\
   $VCROOT32/VC/VCPackages:$SDKROOT64/bin/NETFX4~1.0TO/x64:$SDKROOT64/bin/x64:\
   $SDKROOT64/bin

   ## Microsoft SDK libs

   LIBPATH=$WIN_VCROOT32\\VC\\LIB\\amd64
   LIB=$WIN_VCROOT32\\VC\\LIB\\amd64\;$WIN_SDKROOT64\\LIB\\X64
   INCLUDE=$WIN_VCROOT32\\VC\\INCLUDE\;$WIN_SDKROOT64\\include\;\
   $WIN_SDKROOT64\\include\\gl

   # Put nsis, c compiler and java in path
   PATH=$NSIS_BIN:$VCPATH:$PATH:$JAVA_BIN

   # Make sure LIB and INCLUDE is available for others
   export PATH LIBPATH LIB INCLUDE

    All this is derived from the SetEnv.cmd command file mentioned earlier. The bottom line is to set the PATH so that NSIS and Microsoft SDK is found before the Msys/Cygwin tools and that Java is last in the PATH.

    Make a simple hello world (maybe one that prints out sizeof(void *)) and try to compile it with the cl command from within bash. If that does not work, your environment needs fixing. Also remember to fix up the PATH environment, especially old Erlang installations might have inserted quoted paths that Cygwin/Msys does not understand. Remove or correct such paths. There should be no backslashes in your path environment variable in Cygwin bash, but LIB and INCLUDE should contain Windows style paths with semicolon, drive letters and backslashes.

  • Sun's Java JDK 1.5.0 or higher. Our Java code (jinterface, ic) is written for JDK 1.5.0. Get it for Windows and install it, the JRE is not enough. If you don't care about Java, you can skip this step, the result will be that jinterface is not built.

    URL: http://java.sun.com

    Add javac LAST to your path environment in bash, in my case this means:

    `PATH="$PATH:/cygdrive/c/Program Files/Java/jdk1.5.0_17/bin"`

    No CLASSPATH or anything is needed. Type javac at the bash prompt and you should get a list of available Java options. Make sure by typing type java that you use the Java you installed. Note however that Cygwin's jar.exe is used, that's why the JDK bin-directory should be added last in the PATH.

  • Nullsoft NSIS installer system. You need this to build the self installing package. It's a free open source installer that's much nicer to use than the commercial Wise and Install shield installers. This is the installer we use for commercial releases as well from R9C an on.

    URL: http://www.nullsoft.com/free/nsis

    Install the lot, especially the modern user interface components, as it's definitely needed. Put makensis in your path, in my case:

    PATH=/cygdrive/c/Program\ Files/NSIS:$PATH

    type makensis at the bash prompt and you should get a list of options if everything is OK.

  • OpenSSL. This is if you want the SSL and crypto applications to compile (and run). There are prebuilt binaries available, but I strongly recommend building this yourself. It's quite easy.

    First get the source from

    URL: http://openssl.org/source/

    I would recommend using 0.9.8r.

    Download the tar file and unpack it (using your bash prompt) into a directory of your choise.

    You will need a Windowish Perl for the build. ActiveState has one:

    URL: http://www.activestate.com/activeperl/downloads

    Download and install that. Disable options to associate it with the .pl suffix and/or adding things to PATH, they are not needed.

    Now fire up the Microsoft Windows SDK command prompt in RELEASE mode for the architecture you are going to build. The easiest is to copy the shortcut from the SDKs start menu item and edit the command line in the shortcut (Right click->Properties) to end with /Release. Make sure the banner when you double click your shortcut (the text in the resulting command window) says Targeting Windows XP x64 Release if you are going to do a 64 bit build and Targeting Windows XP x86 Release if you are building a 32 bit version.

    Now cd to where you unpacked the OpenSSL source using your Release Windows command prompt (it should be on the same drive as where you are going to install it if everything is to work smothly).

      C:\> cd <some dir>

    Add ActiveState (or some other windows perl, not cygwins) to your PATH:

      C:\...\> set PATH=C:\Perl\bin;%PATH%

    Or if you installed the 64bit perl:

      C:\...\> set PATH=C:\Perl64\bin;%PATH%

    Configure OpenSSL for 32 bit:

      C:\...\> perl Configure VC-WIN32 --prefix=/OpenSSL

    Or for 64 bit:

      C:\...\> perl Configure VC-WIN64A --prefix=/OpenSSL-Win64

    Do some setup (for 32 bit):

      C:\...\> ms\do_ms

    The same for 64 bit:

      C:\...\> ms\do_win64a

    Then build static libraries and install:

      C:\...\> nmake -f ms\nt.mak
  C:\...\> nmake -f ms\nt.mak install

    That's it - you now have your perfectly consistent static build of openssl. If you want to get rid of any possibly patented algorithms in the lib, just read up on the OpenSSL FAQ and follow the instructions.

    The installation locations chosen are where configure will look for OpenSSL, so try to keep them as is.

  • Building with wxWidgets. Download wxWidgets-2.8.9 or higher patch release (2.9.* is a developer release which currently does not work with wxErlang).

    Install or unpack it to DRIVE:/PATH/cygwin/opt/local/pgm.

    edit: C:\cygwin\opt\local\pgm\wxMSW-2.8.11\include\wx\msw\setup.h enable wxUSE_GLCANVAS, wxUSE_POSTSCRIPT and wxUSE_GRAPHICS_CONTEXT

    build: From a command prompt with the VC tools available (See the instructions for OpenSSL build above for help on starting the proper command prompt in RELEASE mode):

    C:\...\> cd C:\cygwin\opt\local\pgm\wxMSW-2.8.11\build\msw
C:\...\> nmake BUILD=release SHARED=0 UNICODE=1 USE_OPENGL=1 USE_GDIPLUS=1 DIR_SUFFIX_CPU= -f makefile.vc
C:\...\> cd C:\cygwin\opt\local\pgm\wxMSW-2.8.11\contrib\build\stc
C:\...\> nmake BUILD=release SHARED=0 UNICODE=1 USE_OPENGL=1 USE_GDIPLUS=1 DIR_SUFFIX_CPU= -f makefile.vc

    Or - if building a 64bit version:

    C:\...\> cd C:\cygwin\opt\local\pgm\wxMSW-2.8.11\build\msw
C:\...\> nmake TARGET_CPU=amd64 BUILD=release SHARED=0 UNICODE=1 USE_OPENGL=1 USE_GDIPLUS=1 DIR_SUFFIX_CPU= -f makefile.vc
C:\...\> cd C:\cygwin\opt\local\pgm\wxMSW-2.8.11\contrib\build\stc
C:\...\> nmake TARGET_CPU=amd64 BUILD=release SHARED=0 UNICODE=1 USE_OPENGL=1 USE_GDIPLUS=1 DIR_SUFFIX_CPU= -f makefile.vc

  • The Erlang source distribution (from http://www.erlang.org/download.html). The same as for Unix platforms. Preferably use tar from within Cygwin to unpack the source tar.gz (tar zxf otp_src_%OTP-REL%.tar.gz).

    set the environment ERL_TOP to point to the root directory of the source distribution. Let's say I stood in $HOME/src and unpacked otp_src_%OTP-REL%.tar.gz, I then add the following to .profile:

    ERL_TOP=$HOME/src/otp_src_%OTP-REL%
export $ERL_TOP

  • The TCL/TK binaries. You could compile Tcl/Tk for windows yourself, but you can get a stripped down version from our website which is suitable to include in the final binary package. If you want to supply tcl/tk yourself, read the instructions about how the tcl/tk tar file used in the build is constructed under $ERL_TOP/lib/gs/tcl. The easy way is to download http://www.erlang.org/download/tcltk85_win32_bin.tar.gz and unpack it standing in the $ERL_TOP directory. This will create the file win32.tar.gz in $ERL_TOP/lib/gs/tcl/binaries.

    One last alternative is to create a file named SKIP in the $ERL_TOP/lib/gs/ after configure is run, but that will give you an erlang system without gs (which might be okay as you probably will use wx anyway).

    Note that there is no special 64bit version of TCL/TK needed, you can use the 32bit program even for a 64bit build.

The Shell Environment

So, if you have followed the instructions above, when you start a bash shell, you should have an INCLUDE environment with a Windows style path, a LIB environment variable also in Windows style, and finally a PATH that let's you reach cl, makensis, javac etc from the command prompt (use which cl etc to verify from bash).

You should also have an ERL_TOP environment variable that is Cygwin style, and points to a directory containing, among other files, the script otp_build.

A final massage of the environment is needed, and that is done by the script $ERL_TOP/otp_build. Start bash and do the following, note the "back-ticks" (`), can be quite hard to get on some keyboards, but pressing the back-tick key followed by the space bar might do it...

$ cd $ERL_TOP
$ eval `./otp_build env_win32`

If you're unable to produce back-ticks on your keyboard, you can use the ksh variant:

$ cd $ERL_TOP
$ eval $(./otp_build env_win32)

If you are building a 64 bit version, you supply otp_build with an architecture parameter:

$ cd $ERL_TOP
$ eval `./otp_build env_win32 x64`

This should do the final touch to the environment and building should be easy after this. You could run ./otp_build env_win32 without eval just to see what it does, and to see that the environment it sets seems OK. The path is cleaned of spaces if possible (using DOS style short names instead), the variables OVERRIDE_TARGET, CC, CXX, AR and RANLIB are set to their respective wrappers and the directories $ERL_TOP/erts/etc/win32/cygwin_tools/vc and $ERL_TOP/erts/etc/win32/cygwin_tool are added first in the PATH.

Try now a type erlc. That should result in the erlc wrapper script (which does not have the .sh extension, for reasons best kept untold...). It should reside in $ERL_TOP/erts/etc/win32/cygwin_tools or $ERL_TOP/erts/etc/win32/msys_tools. You could also try which cc.sh, which ar.sh etc.

Now you're ready to build...

Building and Installing

Now it's assumed that you have executed eval `./otp_build env_win32` or eval `./otp_build env_win32 x64` for this particular shell...

Building is easiest using the otp_build script. That script takes care of running configure, bootstrapping etc on Windows in a simple way. The otp_build script is the utility we use ourselves to build on different platforms and it therefore contains code for all sorts of platforms. The principle is, however, that for non-Unix platforms, one uses ./otp_build env_<target> to set up environment and then the script knows how to build on the platform "by itself". You've already run ./otp_build env_win32 in the step above, so now it's mostly like we build on any platform. OK, here are then steps; Assuming you will want to build a full installation executable with NSIS, you can omit <installation directory> and the release will be copied to $ERL_TOP/release/win32: and there is where the packed self installing executable will reside too.

$ ./otp_build autoconf # Ignore the warning blob about versions of autoconf
$ ./otp_build configure <optional configure options>
$ ./otp_build boot -a
$ ./otp_build release -a <installation directory>
$ ./otp_build installer_win32 <installation directory> # optional

Now you will have a file called otp_win32_R12B.exe in the <installation directory>, i.e. $ERL_TOP/release/win32.

Lets get into more detail:

  1. $ ./otp_build autoconf - This step rebuilds the configure scripts to work correctly in the cygwin environment. In an ideal world, this would not be needed, but alas, we have encountered several incompatibilities between our distributed configure scripts (generated on a Linux platform) and the cygwin environment over the years. Running autoconf on cygwin ensures that the configure scripts are generated in a cygwin-compatible way and that they will work well in the next step.

  2. $ ./otp_build configure - This runs the newly generated configure scripts with options making configure behave nicely. The target machine type is plainly win32, so a lot of the configure-scripts recognize this awkward target name and behave accordingly. The CC variable also makes the compiler be cc.sh, which wraps MSVC++, so all configure tests regarding the C compiler gets to run the right compiler. A lot of the tests are not needed on Windows, but I thought it best to run the whole configure anyway. The only configure option you might want to supply is --with-ssl, which might be needed if you have built your own OpenSSL distribution. The Shining Lights distribution should be found automatically by configure, if that fails, add a --with-ssl=<dir> that specifies the root directory of your OpenSSL installation.

  3. $ ./otp_build boot -a - This uses the bootstrap directory (shipped with the source, $ERL_TOP/bootstrap) to build a complete OTP system. It first builds an emulator and sets up a minimal OTP system under $ERL_TOP/bootstrap, then starts to compile the different OTP compilers to make the $ERL_TOP/bootstrap system potent enough to be able to compile all Erlang code in OTP. Then, all Erlang and C code under $ERL_TOP/lib is built using the bootstrap system, giving a complete OTP system (although not installed). When this is done, one can run Erlang from within the source tree, just type $ERL_TOP/bin/erl and you should have a prompt. If you omit the -a flag, you'll get a smaller system, that might be useful during development. Now exit from Erlang and start making a release of the thing:

  4. $ ./otp_build release -a - Builds a commercial release tree from the source tree, default is to put it in $ERL_TOP/release/win32, you can give any directory as parameter (Cygwin style), but it doesn't really matter if you're going to build a self extracting installer too. You could of course build release to the final directory and then run ./Install.exe standing in the directory where the release was put, that will create a fully functional OTP installation. But let's make the nifty installer:

  5. $ ./otp_build installer_win32 - Create the self extracting installer executable. The executable otp_win32_%OTP-REL%.exe will be placed in the top directory of the release created in the previous step. If no release directory is specified, the release is expected to have been built to $ERL_TOP/release/win32, which also will be the place where the installer executable will be placed. If you specified some other directory for the release (i.e. ./otp_build release -a /tmp/erl_release), you're expected to give the same parameter here, (i.e. ./otp_build installer_win32 /tmp/erl_release). You need to have a full NSIS installation and makensis.exe in your path for this to work of course. Once you have created the installer, you can run it to install Erlang/OTP in the regular way, just run the executable and follow the steps in the installation wizard. To get all default settings in the installation without any questions asked, you run the executable with the parameter /S (capital S) like in:

    $ cd $ERL_TOP
$ release/win32/otp_win32_%OTP-REL% /S
...

    or

    $ cd $ERL_TOP
$ release/win32/otp_win64_%OTP-REL% /S
...

    and after a while Erlang/OTP-%OTP-REL% will have been installed in C:\Program Files\erl%ERTS-VSN%\, with shortcuts in the menu etc.

    The necessary setup of an Erlang installation is actually done by the program Install.exe, which resides in the release top. That program creates .ini-files and copies the correct boot scripts. If one has the correct directory tree (like after a ./otp_build release -a), only the running of Install.exe is necessary to get a fully functional OTP. What the self extracting installer adds is (of course) the possibility to distribute the binary easily, together with adding shortcuts to the Windows start menu. There is also some adding of entries in the registry, to associate .erl and .beam files with Erlang and get nifty icons, but that's not something you'll really need to run Erlang. The registry is also used to store uninstall information, but if one has not used the self extracting installer, one cannot (need not) do any uninstall, one just scratches the release directory and everything is gone. Erlang/OTP does not need to put anything in the Windows registry at all, and does not if you don't use the self extracting installer. In other words the installer is pure cosmetics.

NOTE: Beginning with R9C, the Windows installer does not add Erlang to the system wide path. If one wants to have Erlang in the path, one has to add it by hand.

Development

Once the system is built, you might want to change it. Having a test release in some nice directory might be useful, but you also can run Erlang from within the source tree. The target local_setup, makes the program $ERL_TOP/bin/erl.exe usable and it also uses all the OTP libraries in the source tree.

If you hack the emulator, you can then build the emulator executable by standing in $ERL_TOP/erts/emulator and do a simple

$ make opt

Note that you need to have run (cd $ERL_TOP && eval `./otp_build env_win32`) in the particular shell before building anything on Windows. After doing a make opt you can test your result by running $ERL_TOP/bin/erl. If you want to copy the result to a release directory (say /tmp/erl_release), you do this (still in $ERL_TOP/erts/emulator)

$ make TESTROOT=/tmp/erl_release release

That will copy the emulator executables.

To make a debug build of the emulator, you need to recompile both beam.dll (the actual runtime system) and erlexec.dll. Do like this

$ cd $ERL_TOP
$ rm bin/win32/erlexec.dll
$ cd erts/emulator
$ make debug
$ cd ../etc
$ make debug

and sometimes

$ cd $ERL_TOP
$ make local_setup

So now when you run $ERL_TOP/erl.exe, you should have a debug compiled emulator, which you will see if you do a:

1> erlang:system_info(system_version).

in the erlang shell. If the returned string contains [debug], you got a debug compiled emulator.

To hack the erlang libraries, you simply do a make opt in the specific "applications" directory, like:

$ cd $ERL_TOP/lib/stdlib
$ make opt

or even in the source directory...

$ cd $ERL_TOP/lib/stdlib/src
$ make opt

Note that you're expected o have a fresh Erlang in your path when doing this, preferably the plain %OTP-REL% you have built in the previous steps. You could also add $ERL_TOP/bootstrap/bin to your PATH before rebuilding specific libraries, that would give you a good enough Erlang system to compile any OTP erlang code. Setting up the path correctly is a little bit tricky, you still need to have $ERL_TOP/erts/etc/win32/cygwin_tools/vc and $ERL_TOP/erts/etc/win32/cygwin_tools before the actual emulator in the path. A typical setting of the path for using the bootstrap compiler would be:

$ export PATH=$ERL_TOP/erts/etc/win32/cygwin_tools/vc\
:$ERL_TOP/erts/etc/win32/cygwin_tools:$ERL_TOP/bootstrap/bin:$PATH

That should make it possible to rebuild any library without hassle...

If you want to copy a library (an application) newly built, to a release area, you do like with the emulator:

$ cd $ERL_TOP/lib/stdlib
$ make TESTROOT=/tmp/erlang_release release

Remember that:

  • Windows specific C-code goes in the $ERL_TOP/erts/emulator/sys/win32, $ERL_TOP/erts/emulator/drivers/win32 or $ERL_TOP/erts/etc/win32.

  • Windows specific erlang code should be used conditionally and the host OS tested in runtime, the exactly same beam files should be distributed for every platform! So write code like:

    case os:type() of
    {win32,_} ->
        do_windows_specific();
    Other ->
        do_fallback_or_exit()
end,

That's basically all you need to get going.

Using GIT

You might want to check out versions of the source code from GitHUB. That is possible directly in cygwin, but not in Msys. There is a project MsysGIT:

URL:http://code.google.com/p/msysgit/

that makes a nice Git port. The msys prompt you get from MsysGIT is however not compatible with the full version from MinGW, so you will need to check out files using MsysGIT's command prompt and then switch to a common Msys command prompt for building. Also all test suites cannot be built as MsysGIT/Msys does not handle symbolic links. To build test suites on Windows, you will need Cygwin for now. Hopefully all symbolic links will disappear from our repository soon and this issue will disappear.

Final Words

My hope is that the possibility to build the whole system on Windows will open up for free development on this platform too. There are many things one might want to do better in the Windows version, like the window-style command prompt as well as pure Cygwin porting. Although i realize it's a much larger step to start building on Windows (with all the software you need) than for instance on Linux, I sincerely hope that some of you will make the effort and start submitting Windows friendly patches.

The first build system for Erlang using Cygwin on Windows was created by Per Bergkvist. I haven't used his build system, but it's rumored to be good. The idea to do this came from his work, so credit is well deserved.

Of course this would have been completely impossible without the excellent Cygwin. The guys at Cygnus solutions and Redhat deserve a huge THANKS! as well as all the other people in the free software community who have helped in creating the magnificent software that constitutes Cygwin.

Also the people developing the alternative command prompt Msys and the MinGW compiler are worth huge THANKS! The 64bit port would have been impossible without the 64bit MinGW compiler.

Good luck and Happy Hacking, Patrik, OTP

Copyright and License

%CopyrightBegin%

Copyright Ericsson AB 2003-2012. All Rights Reserved.

The contents of this file are subject to the Erlang Public License, Version 1.1, (the "License"); you may not use this file except in compliance with the License. You should have received a copy of the Erlang Public License along with this software. If not, it can be retrieved online at http://www.erlang.org/.

Software distributed under the License is distributed on an "AS IS" basis, WITHOUT WARRANTY OF ANY KIND, either express or implied. See the License for the specific language governing rights and limitations under the License.

%CopyrightEnd%

Modifying This Document

Before modifying this document you need to have a look at the $ERL_TOP/HOWTO/MARKDOWN.md document.