[QUESTION] How to cross-compile luajit.so library for Android on Windows? #120

leasses · 2023-09-01T05:25:01Z

leasses
Sep 1, 2023

Hello gudzpoz, long time no see.
I want to compile a Luajit for myself because I need to modify sources of Luajit to add some features like continue keyword, switch and case, etc.

So these days I did some research on it:

Luajit cannot be compiled with the NDK of Android Studio which uses Android.mk or CMakeLists.txt. It means we can only compile it with gcc and make on Linux.
But I have no any experience on how to install a Linux on my laptop. So I tried to make it with Visual Studio, but it gave me luajit.exe that is not the file I wanted.
Luckily, I found some tools like Cygwin64, minGW can create a terminal with a Linux environment so that I can use make to cross-compile.
I used the script in this repository(luajit/jni/scripts/build-android.sh) and set NDK_HOME to my local NDK directory, I also knew to add TARGET_SYS=linux. I will add a new comment to show the full modified script.
All is done. I opened the Cygwin64 terminal and executed it, and it failed. But it only failed in building arm-v7a and i386. I will show you the full log in next comment.

Thanks!

Answered by gudzpoz

Sep 3, 2023

Quoting Mike Pall: LuaJIT/LuaJIT#934 (comment)

CygWin is not a fully supported target.

And judging from the official documentation:

Yes, you need a toolchain for both your host and your target!

Both host and target architectures must have the same pointer size.

E.g. if you want to cross-compile to a 32 bit target on a 64 bit host, you need to install the multilib development package (e.g. libc6-dev-i386 on Debian/Ubuntu) and build a 32 bit host part (HOST_CC="gcc -m32").

You will need to figure out things yourself if you plan to continue using Cygwin.

If you are having problems installing Linux, I would recommend install it on a virtual machine instead (with, for example, Virtual…

View full answer

leasses · 2023-09-01T05:27:58Z

leasses
Sep 1, 2023
Author

The following is the full modified script:

#!/usr/bin/env sh
# From https://github.com/mjansson/lua_lib/blob/master/lua/luajit/build-android.sh
# Fixed https://github.com/LuaJIT/LuaJIT/issues/440#issuecomment-438809840
# From https://github.com/gudzpoz/luajava/blob/main/luajit/jni/scripts/build-android.sh
# Add sopport to Windows

# /cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit

LUAJIT=.

BUILD_DIR=$LUAJIT/lib

rm -rf $BUILD_DIR
mkdir -p $BUILD_DIR
rm *.a 1>/dev/null 2>/dev/null

HOST_OS=windows
TARGET_SYS=Linux

NDK=/cygdrive/c/Users/29169/AppData/Local/Android/Sdk/ndk/25.2.9519653
TOOLCHAIN=$NDK/toolchains/llvm/prebuilt/$HOST_OS-x86_64
NDKB=$TOOLCHAIN/bin
NDKAPI=19

echo "########## Building armv7-a ##########"
TARGET=armv7a-linux-androideabi
NDKP=$NDKB/${TARGET}-
NDKCC=$NDKB/${TARGET}${NDKAPI}-clang
NDKARCH="-march=armv7-a -mhard-float -mfpu=vfpv3-d16 -mfloat-abi=softfp -D_NDK_MATH_NO_SOFTFP=1 -marm -DNO_RTLD_DEFAULT=1"
make HOST_CC="gcc -m32 -I/usr/i686-linux-gnu/include" CROSS=$NDKP \
     STATIC_CC=$NDKCC DYNAMIC_CC="$NDKCC -fPIC" \
     TARGET_LD=$NDKCC TARGET_AR="$NDKB/llvm-ar rcus" TARGET_STRIP=$NDKB/llvm-strip \
     CFLAGS=-fPIC TARGET_FLAGS="$NDKARCH" TARGET_SYS="$TARGET_SYS" \
     clean
make HOST_CC="gcc -m32 -I/usr/i686-linux-gnu/include" CROSS=$NDKP \
     STATIC_CC=$NDKCC DYNAMIC_CC="$NDKCC -fPIC" \
     TARGET_LD=$NDKCC TARGET_AR="$NDKB/llvm-ar rcus" TARGET_STRIP=$NDKB/llvm-strip \
     CFLAGS=-fPIC TARGET_FLAGS="$NDKARCH" TARGET_SYS="$TARGET_SYS" \
     amalg
mkdir -p $BUILD_DIR/armeabi-v7a
mv $LUAJIT/src/libluajit.a $BUILD_DIR/armeabi-v7a/libluajit.a

echo "########## Building i686 ##########"
TARGET=i686-linux-android
NDKP=$NDKB/${TARGET}-
NDKCC=$NDKB/${TARGET}${NDKAPI}-clang
NDKARCH="-DNO_RTLD_DEFAULT=1"
make HOST_CC="gcc -m32 -I/usr/i686-linux-gnu/include" CROSS=$NDKP \
     STATIC_CC=$NDKCC DYNAMIC_CC="$NDKCC -fPIC" \
     TARGET_LD=$NDKCC TARGET_AR="$NDKB/llvm-ar rcus" TARGET_STRIP=$NDKB/llvm-strip \
     CFLAGS=-fPIC TARGET_FLAGS="$NDKARCH" TARGET_SYS="$TARGET_SYS" \
     clean
make HOST_CC="gcc -m32 -I/usr/i686-linux-gnu/include" CROSS=$NDKP \
     STATIC_CC=$NDKCC DYNAMIC_CC="$NDKCC -fPIC" \
     TARGET_LD=$NDKCC TARGET_AR="$NDKB/llvm-ar rcus" TARGET_STRIP=$NDKB/llvm-strip \
     CFLAGS=-fPIC TARGET_FLAGS="$NDKARCH" TARGET_SYS="$TARGET_SYS" \
     amalg
mkdir $BUILD_DIR/x86
mv $LUAJIT/src/libluajit.a $BUILD_DIR/x86/libluajit.a

NDKAPI=21

echo "########## Building arm64-v8a ##########"
TARGET=aarch64-linux-android
NDKP=$NDKB/${TARGET}-
NDKCC=$NDKB/${TARGET}${NDKAPI}-clang
NDKARCH="-DLJ_ABI_SOFTFP=0 -DLJ_ARCH_HASFPU=1 -DLUAJIT_ENABLE_GC64=1 -DNO_RTLD_DEFAULT=1"
make HOST_CC="gcc -m64" CROSS=$NDKP \
     STATIC_CC=$NDKCC DYNAMIC_CC="$NDKCC -fPIC" \
     TARGET_LD=$NDKCC TARGET_AR="$NDKB/llvm-ar rcus" TARGET_STRIP=$NDKB/llvm-strip \
     CFLAGS=-fPIC TARGET_FLAGS="$NDKARCH" TARGET_SYS="$TARGET_SYS" \
     clean
make HOST_CC="gcc -m64" CROSS=$NDKP \
     STATIC_CC=$NDKCC DYNAMIC_CC="$NDKCC -fPIC" \
     TARGET_LD=$NDKCC TARGET_AR="$NDKB/llvm-ar rcus" TARGET_STRIP=$NDKB/llvm-strip \
     CFLAGS=-fPIC TARGET_FLAGS="$NDKARCH" TARGET_SYS="$TARGET_SYS" \
     amalg
mkdir -p $BUILD_DIR/arm64-v8a
mv $LUAJIT/src/libluajit.a $BUILD_DIR/arm64-v8a/libluajit.a

echo "########## Building x86_64 ##########"
TARGET=x86_64-linux-android
NDKP=$NDKB/${TARGET}-
NDKCC=$NDKB/${TARGET}${NDKAPI}-clang
NDKARCH="-DLUAJIT_ENABLE_GC64=1 -DNO_RTLD_DEFAULT=1"
make HOST_CC="gcc -m64" CROSS=$NDKP \
     STATIC_CC=$NDKCC DYNAMIC_CC="$NDKCC -fPIC" \
     TARGET_LD=$NDKCC TARGET_AR="$NDKB/llvm-ar rcus" TARGET_STRIP=$NDKB/llvm-strip \
     CFLAGS=-fPIC TARGET_FLAGS="$NDKARCH" TARGET_SYS="$TARGET_SYS" \
     clean
make HOST_CC="gcc -m64" CROSS=$NDKP \
     STATIC_CC=$NDKCC DYNAMIC_CC="$NDKCC -fPIC" \
     TARGET_LD=$NDKCC TARGET_AR="$NDKB/llvm-ar rcus" TARGET_STRIP=$NDKB/llvm-strip \
     CFLAGS=-fPIC TARGET_FLAGS="$NDKARCH" TARGET_SYS="$TARGET_SYS" \
     amalg
mkdir -p $BUILD_DIR/x86_64
mv $LUAJIT/src/libluajit.a $BUILD_DIR/x86_64/libluajit.a

The following is the full log:

29169@DESKTOP-6HQ2M02 /cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit
$ sh build.sh
########## Building armv7-a ##########
make -C src clean
make[1]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
rm -f luajit libluajit.a libluajit.so host/minilua.exe host/buildvm.exe lj_vm.S lj_bcdef.h lj_ffdef.h lj_libdef.h lj_recdef.h lj_folddef.h host/buildvm_arch.h luajit.h luajit_relver.txt jit/vmdef.lua *.o host/*.o *.obj *.lib *.exp *.dll *.exe *.manifest *.pdb *.ilk
make[1]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
==== Building LuaJIT 2.1 (amalgamation) ====
make -C src amalg
make[1]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make all "LJCORE_O=ljamalg.o"
make[2]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
HOSTCC    host/minilua.o
In file included from /usr/include/sys/signal.h:23:0,
                 from /usr/include/signal.h:6,
                 from /usr/include/machine/setjmp.h:410,
                 from /usr/include/setjmp.h:10,
                 from host/minilua.c:39:
/usr/include/cygwin/signal.h:102:2: error: #error unimplemented for this target
 #error unimplemented for this target
  ^~~~~
In file included from /usr/include/sys/signal.h:379:0,
                 from /usr/include/signal.h:6,
                 from /usr/include/machine/setjmp.h:410,
                 from /usr/include/setjmp.h:10,
                 from host/minilua.c:39:
/usr/include/sys/ucontext.h:17:13: error: field ‘uc_mcontext’ has incomplete type
  mcontext_t uc_mcontext;
             ^~~~~~~~~~~
make[2]: *** [Makefile:715: host/minilua.o] Error 1
make[2]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make[1]: *** [Makefile:619: amalg] Error 2
make[1]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make: *** [Makefile:165: amalg] Error 2
mv: cannot stat './src/libluajit.a': No such file or directory
########## Building i686 ##########
make -C src clean
make[1]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
rm -f luajit libluajit.a libluajit.so host/minilua.exe host/buildvm.exe lj_vm.S lj_bcdef.h lj_ffdef.h lj_libdef.h lj_recdef.h lj_folddef.h host/buildvm_arch.h luajit.h luajit_relver.txt jit/vmdef.lua *.o host/*.o *.obj *.lib *.exp *.dll *.exe *.manifest *.pdb *.ilk
make[1]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
==== Building LuaJIT 2.1 (amalgamation) ====
make -C src amalg
make[1]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make all "LJCORE_O=ljamalg.o"
make[2]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
HOSTCC    host/minilua.o
In file included from /usr/include/sys/signal.h:23:0,
                 from /usr/include/signal.h:6,
                 from /usr/include/machine/setjmp.h:410,
                 from /usr/include/setjmp.h:10,
                 from host/minilua.c:39:
/usr/include/cygwin/signal.h:102:2: error: #error unimplemented for this target
 #error unimplemented for this target
  ^~~~~
In file included from /usr/include/sys/signal.h:379:0,
                 from /usr/include/signal.h:6,
                 from /usr/include/machine/setjmp.h:410,
                 from /usr/include/setjmp.h:10,
                 from host/minilua.c:39:
/usr/include/sys/ucontext.h:17:13: error: field ‘uc_mcontext’ has incomplete type
  mcontext_t uc_mcontext;
             ^~~~~~~~~~~
make[2]: *** [Makefile:715: host/minilua.o] Error 1
make[2]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make[1]: *** [Makefile:619: amalg] Error 2
make[1]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make: *** [Makefile:165: amalg] Error 2
mv: cannot stat './src/libluajit.a': No such file or directory
########## Building arm64-v8a ##########
make -C src clean
make[1]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
rm -f luajit libluajit.a libluajit.so host/minilua.exe host/buildvm.exe lj_vm.S lj_bcdef.h lj_ffdef.h lj_libdef.h lj_recdef.h lj_folddef.h host/buildvm_arch.h luajit.h luajit_relver.txt jit/vmdef.lua *.o host/*.o *.obj *.lib *.exp *.dll *.exe *.manifest *.pdb *.ilk
make[1]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
==== Building LuaJIT 2.1 (amalgamation) ====
make -C src amalg
make[1]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make all "LJCORE_O=ljamalg.o"
make[2]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
HOSTCC    host/minilua.o
HOSTLINK  host/minilua.exe
VERSION   luajit.h
DYNASM    host/buildvm_arch.h
HOSTCC    host/buildvm.o
HOSTCC    host/buildvm_asm.o
HOSTCC    host/buildvm_peobj.o
HOSTCC    host/buildvm_lib.o
HOSTCC    host/buildvm_fold.o
HOSTLINK  host/buildvm.exe
BUILDVM   lj_vm.S
ASM       lj_vm.o
BUILDVM   lj_ffdef.h
BUILDVM   lj_bcdef.h
BUILDVM   lj_folddef.h
BUILDVM   lj_recdef.h
BUILDVM   lj_libdef.h
CC        ljamalg.o
AR        libluajit.a
CC        luajit.o
BUILDVM   jit/vmdef.lua
DYNLINK   libluajit.so
LINK      luajit
OK        Successfully built LuaJIT
make[2]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make[1]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
==== Successfully built LuaJIT 2.1 (amalgamation) ====
########## Building x86_64 ##########
make -C src clean
make[1]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
rm -f luajit libluajit.a libluajit.so host/minilua.exe host/buildvm.exe lj_vm.S lj_bcdef.h lj_ffdef.h lj_libdef.h lj_recdef.h lj_folddef.h host/buildvm_arch.h luajit.h luajit_relver.txt jit/vmdef.lua *.o host/*.o *.obj *.lib *.exp *.dll *.exe *.manifest *.pdb *.ilk
make[1]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
==== Building LuaJIT 2.1 (amalgamation) ====
make -C src amalg
make[1]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make all "LJCORE_O=ljamalg.o"
make[2]: Entering directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
HOSTCC    host/minilua.o
HOSTLINK  host/minilua.exe
VERSION   luajit.h
DYNASM    host/buildvm_arch.h
HOSTCC    host/buildvm.o
HOSTCC    host/buildvm_asm.o
HOSTCC    host/buildvm_peobj.o
HOSTCC    host/buildvm_lib.o
HOSTCC    host/buildvm_fold.o
HOSTLINK  host/buildvm.exe
BUILDVM   lj_vm.S
ASM       lj_vm.o
BUILDVM   lj_ffdef.h
BUILDVM   lj_bcdef.h
BUILDVM   lj_folddef.h
BUILDVM   lj_recdef.h
BUILDVM   lj_libdef.h
CC        ljamalg.o
AR        libluajit.a
CC        luajit.o
BUILDVM   jit/vmdef.lua
DYNLINK   libluajit.so
LINK      luajit
OK        Successfully built LuaJIT
make[2]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
make[1]: Leaving directory '/cygdrive/c/Users/29169/Documents/AndroidProjects/Zuie/app/src/main/jni/luajit/src'
==== Successfully built LuaJIT 2.1 (amalgamation) ====

0 replies

gudzpoz · 2023-09-03T07:33:56Z

gudzpoz
Sep 3, 2023
Maintainer

Quoting Mike Pall: LuaJIT/LuaJIT#934 (comment)

CygWin is not a fully supported target.

And judging from the official documentation:

Yes, you need a toolchain for both your host and your target!

Both host and target architectures must have the same pointer size.

E.g. if you want to cross-compile to a 32 bit target on a 64 bit host, you need to install the multilib development package (e.g. libc6-dev-i386 on Debian/Ubuntu) and build a 32 bit host part (HOST_CC="gcc -m32").

You will need to figure out things yourself if you plan to continue using Cygwin.

If you are having problems installing Linux, I would recommend install it on a virtual machine instead (with, for example, VirtualBox). For build dependencies, you may follow the GitHub workflow:

luajava/.github/workflows/build-natives.yml

Lines 79 to 88 in 15cf1b4

    
                     sudo apt update 
        
                     sudo apt install -y --force-yes gcc g++ linux-libc-dev libc6-dev 
        
                     sudo apt install -y --force-yes libc6-dev-i386 lib32stdc++-9-dev 
        
                     sudo apt install -y --force-yes linux-libc-dev linux-libc-dev-i386-cross 
        
                     sudo apt install -y --force-yes linux-libc-dev-armhf-cross linux-libc-dev-arm64-cross linux-libc-dev-amd64-cross 
        
                     sudo apt install -y --force-yes libstdc++-9-dev-i386-cross libstdc++-9-dev-arm64-cross libstdc++-9-dev-armhf-cross 
        
                     sudo apt install -y --force-yes gcc-i686-linux-gnu g++-i686-linux-gnu libc6-dev-i386-cross 
        
                     sudo apt install -y --force-yes gcc-aarch64-linux-gnu g++-aarch64-linux-gnu libc6-dev-arm64-cross 
        
                     sudo apt install -y --force-yes gcc-arm-linux-gnueabihf g++-arm-linux-gnueabihf libc6-dev-armhf-cross 
        
                     sudo apt install -y --force-yes mingw-w64 lib32z1

0 replies

leasses · 2023-09-04T02:41:00Z

leasses
Sep 4, 2023
Author

Thanks for replying!
Yes, the problem file signal.h is not a part of Luajit so it's possibly a problem caused by Cygwin.
I also tried to install some x86 library for cygwin(like libc6-dev-i386), but find nothing in setup wizard of cygwin.

Sadly, my computer is too low-end to support Hype-V feature so I cannot install a virtual system.
But I noticed Github provided a Ubuntu server for Github Actions. Is there any way to compile it with Github Actions?

2 replies

gudzpoz Sep 5, 2023
Maintainer

Yes, of course you can use GitHub Actions, which this luajava project actually uses to build its binaries.

leasses Sep 5, 2023
Author

Thanks, I will try it!

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[QUESTION] How to cross-compile luajit.so library for Android on Windows? #120

{{title}}

Replies: 3 comments 2 replies

{{title}}

{{editor}}'s edit

{{editor}}'s edit

{{title}}

{{title}}

{{title}}

{{title}}

Select a reply

[QUESTION] How to cross-compile luajit.so library for Android on Windows? #120

leasses Sep 1, 2023

Replies: 3 comments · 2 replies

leasses Sep 1, 2023 Author

gudzpoz Sep 3, 2023 Maintainer

leasses Sep 4, 2023 Author

gudzpoz Sep 5, 2023 Maintainer

leasses Sep 5, 2023 Author

leasses
Sep 1, 2023

Replies: 3 comments 2 replies

leasses
Sep 1, 2023
Author

gudzpoz
Sep 3, 2023
Maintainer

leasses
Sep 4, 2023
Author

gudzpoz Sep 5, 2023
Maintainer

leasses Sep 5, 2023
Author