This patch adds a specific build for musl. Currently, it will only support JIT engine.

I also changes the workflow definition a bit so we don't depend on the OS name but rather on the environment ID which is our convention.

Closes #1482 Closes #1766

Description

Review

• [ ] Add a short description of the the change to the CHANGELOG.md file

Description

This PR aims to improve compilation times by caching via sccache. We are using paritytech's sccache as is more updated than mozilla's one.

I considered other options such as:

• Using Github Actions cache for target: discarded because the limit is 5Gb and given the multiple OSs used, in my local folder a clean cache is ~700Mb (just with cranelift)... estimated ~1-2Gb with all compilers included.

Description

This PR focuses on improving the speed that we run the tests:

• [x] Unified C API tests. No more recompilation will be needed for testing different compilers. We bundle all in one object and test based on a environment variable TEST
• [x] Simplified Rust tests so only one compilation is needed. Not counting compilation time, here are the new testing times:
  • Building times:
    • test crates: ~3 mins
    • capi: ~2 mins
  • Singlepass: cargo test --features singlepass
    • jit: 3 seconds (170 passed; 0 failed; 342 ignored;)
  • Cranelift: cargo test --features cranelift
    • jit: 25 seconds (232 passed; 2 failed; 24 ignored; 0 measured; 258 filtered out;)
    • native: 12 minutes (256 passed, 2 failed; 24. ignored)
  • LLVM cargo test --features llvm
    • jit: 42 seconds (238 passed; 0 failed; 18 ignored; 0 measured; 256 filtered out)
    • native: (haven't go through everything yet)
  • CAPI: make test-capi. Total ~4 min.
    • singlepass+jit:
    • cranelift+jit
    • cranelift+native
    • llvm+jit
    • llvm+native
• [x] Refactored a bit ignores.txt, now it is possible to target multiple features at the same time (OS, chipset, engine, compiler, ...) (small caveat: tests have to be "namespaced" because of some proc_macro2 issues with Span and source_file().

If I had to guess I think we are going to see at least a 80% improvement on test times, and a much nicer way of testing (just with cargo). There are around 1-3secs on build time that will be increased from the macros I created but the tradeoff is great.

You now want to tests all the simd tests for the llvm compiler at the same time (both engines)? No problem:

cargo test --features llvm --tests -- simd

You want to run absolutely all the tests with all compilers and engines at the same time? (excluding package tests and c-api of course). No prob:

cargo test --features singlepass,cranelift,llvm

Also, do you want to test the capi in all compilers and engines at the same time? Wait no more:

make test-capi

Review

• [ ] Add a short description of the change to the CHANGELOG.md file

Description

As mentioned in #2180, load a native artifact is slow because of deserialization ModuleMetadata. This draft PR show how fast it can be when serialize it archive to a [u8] that can be directly read back and interprete as nested struct/HashMap/PrimaryMap without a deserialization. Run

cargo bench -p wasmer-cache --features singlepass

from root dir, will see a lot of timeing in the end:

...
3.447994ms // bincode::deserialize
rkyv 22ns
rkyv deser 386.539µs

This PR use a forked rkyv, for impl rkyv traits on PrimaryMap and IndexMap. TODO:

• [x] in fork rkyv, impl rkyv traits on IndexMap is not guanranteed keep indexmap's order, just a quick hack to see timing (reuse ArchivedHashMap). need to impl a real ArchivedIndexMap
• ~[ ] replace each use of ModuleMetadata and children to ArchivedModuleMetadata or something like:~

enum ModuleMetadataWrap {
    Original(ModuleMetadata),
    Archived(ArchivedModuleMetadata)
}

~and field access to ModuleMetadataWrap method calls~

• [x] rkyv deserialize is not as fast as rkyv archive, but fast enough and advantage is minimum change to wasmer's struct field access code, so I plan to use rkyv deserialize
• [x] add a test to ensure rkyv does deserialize correctly. I added assert to see deserialized obj is Eq to original, need to turn it to a unit test.
• [x] move impl rkyv::* for PrimaryMap/IndexMap inside this PR, instead of using a fork of rkyv, using a remote-derive technique

Review

• [ ] Add a short description of the the change to the CHANGELOG.md file

Setup LLVM automatically for LLVM backend. It now supports Mac OS and Linux.

Description

Port the code from https://github.com/wasmerio/wasmer/pull/353. I created a new PR because the code in the master branch has changed a lot since the previous PR made.

The automatic installing is enabled the following conditions:

• The system LLVM doesn't exist.
• Your environment is Mac OS or Linux.
• Internet connection exists.
• The flag to disable installing isn't set.
  • LLVM_SYS_80_DISABLE_INSTALL=1 cargo run can disable to install LLVM.

Description

This PR makes some fairly simple changes to feature flags so that forks originally intended *-apple-darwin now work for both aarch64-apple-ios/x86_64-apple-ios.

Review

• [ ] Add a short description of the change to the CHANGELOG.md file

The purpose of this PR is to speed up our CI by speeding up the slowest step. Rather than running docker as part of this process, we just run this entire job in the alpine container. I'm hoping this will recover a significant amount of performance.

Review

• [ ] Add a short description of the change to the CHANGELOG.md file

Reorganizing some of our tests.

Still tests left to migrate and a few bugs to fix.

Review

• [ ] Add a short description of the the change to the CHANGELOG.md file

In an earlier version of the C API the trampoline functions were marked as deprecated. Now it seems they've been deleted, and I can't find their replacement. The deprecation message mentioned exposing DynamicFunc::new to the C API. Any word on that?

Is it possible/advisable to use wasmer_import_func_new directly? The documentation for that function isn't very clear, so I'm not sure how my imported function maps to the void (*func)(void *data).

Work in progress, we don't assert on the output at all, just testing to see if this will work in CI

Review

• [ ] Add a short description of the the change to the CHANGELOG.md file

Description

This PR contains 2 parts. Don't be afraid, it's very small changes, and it's easy to follow.

How to Review

I recommend to review the PR patch by patch, it's way simpler than reading the final diff. Note that the matrix (the table in the Makefile documentation) is updated patch after patch, so this part should ideally be reviewed in the final diff.

The final Makefile is here, https://github.com/Hywan/wasmer/blob/feat-c-api-build-lib-with-all-compilers-and-engines/Makefile, and it's even easier to read now.

Part 1, The Matrix

The set of patches writes a matrix: platform x architecture x compiler x engine x libc, and for each combination, says if it's supported or not.

This set of patches updates the “prelude” of the Makefile to make it clearler and easier to read, regarding the matrix.

1. adb7c59, This patch removes the UNAME_S and ARCH variables. It replaces them with IS_WINDOWS, IS_LINUX, IS_DARWIN, IS_AMD64, and IS_AARCH64 variables. It makes the code easier to read and simpler to maintain.

   This patch also documents the large matrix of platform x architecture x compiler x engine x lib support.

2. 659bdb0, This patch removes a possible duplication of the llvm value inside the compilers variable if both LLVM 10 and 11 are available.

   This patch also checks for LLVM 11 before LLVM 10.

3. 7b38752, This patch moves all the assignments of compilers in the same place for the sake of clarity.

4. 006c653, This patch renames the test_compilers_engines variable to compilers_engines. We can use this variable for test purposes, but more importantly, it defines all the pair (compiler, engine), make it that clear.

   I've decided to separate this patch from the followings to facilitate the review.

5. 67a1dfe, This patch handles the (cranelift, *) pairs in a single place.

6. f3c729d, This patch handles the (llvm, *) pairs in a single place.

7. 1054e51, This patch handles the (singlepass, *) pairs in a single place.

8. 07e48b4 , This patch adds the HAS_<compiler> variables, it makes the code easier to read.

9. 06d543a, 660daba, 95dcb04, 6721769, and 62c7889 are small improvements.

10. 0a0b7f8, This patch introduces ENABLE_<compiler> variables, that can be overriden by the user to force to enable or to disable a compiler. They replace the HAS_<compiler> variables.

Part 2, libwasmer includes all available compilers

1. 387a753, This patch updates the build-capi rule to no longer uses Cranelift by default, but to include/enable all the available compilers.

2. f846a0d, This patch explains test-capi with a little bit more details.

   This patch also introduces the test-capi-all rule. Why? test-capi will continue to build and to test the C API with a single compiler enabled, so that it's the default one that will be used by the tests. But we also want to test the libwasmer we are giving to the users! That's what test-capi-all does. Notice that the test-capi rule depends test-capi-all, so we don't need to update the CI.

Closes https://github.com/wasmerio/wasmer/pull/2063

Review

• [x] Add a short description of the the change to the CHANGELOG.md file

Description

Singlepass SSE4.2 backend have to convert 3-ways AVX operator to 2-ways SSE operator. Some cases where dst == src1 were not handled and would panic. This should fix those cases

For ticket #3461

Describe the bug

I run a simple instance of WASM compiled using singlepass using the following features :

    const FEATURES: Features = Features {
        threads: false,
        reference_types: false,
        simd: false,           
        bulk_memory: true,     
        multi_value: false,   
        tail_call: false,      
        module_linking: false, 
        multi_memory: false,   
        memory64: false,      
        exceptions: false,
        relaxed_simd: false,
        extended_const: false,
    };

Steps to reproduce

I'm having an error on a VPS where I have this information about the CPU :

***@***.***:~# cat /proc/cpuinfo
processor       : 0
vendor_id       : AuthenticAMD
cpu family      : 6
model           : 13
model name      : QEMU Virtual CPU version 2.5+
stepping        : 3
microcode       : 0x1000065
cpu MHz         : 1996.230
cache size      : 512 KB
physical id     : 0
siblings        : 8
core id         : 0
cpu cores       : 8
apicid          : 0
initial apicid  : 0
fpu             : yes
fpu_exception   : yes
cpuid level     : 13
wp              : yes
flags           : fpu de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ht syscall nx lm nopl cpuid tsc_known_freq pni pclmulqdq ssse3 cx16 sse4_1 sse4_2 x2apic popcnt aes xsave rdrand hypervisor lahf_lm cmp_legacy abm 3dnowprefetch ssbd ibpb vmmcall arch_capabilities
bugs            : fxsave_leak sysret_ss_attrs null_seg spectre_v1 spectre_v2 spec_store_bypass
bogomips        : 3992.46
TLB size        : 1024 4K pages
clflush size    : 64
cache_alignment : 64
address sizes   : 40 bits physical, 48 bits virtual
...

Expected behavior

Run without error

Actual behavior

thread '' panicked at 'assertion failed: (left != right)
 left: XMM3,
 right: XMM3', /root/.cargo/registry/src/github.com-1ecc6299db9ec823/wasmer-compiler-singlepass-3.1.0/src/emitter_x64.rs:1752:40

Additional context

I'm sorry I can't provide source that I'm using as it's part of a big project. I assume it's an error with the CPU architecture but if you can give me details it could be great.

This is a followup for https://github.com/wasmerio/wasmer/pull/3430 - currently the test_cross_compile_python_windows and test_wasmer_create_exe_pirita_works don't work on windows when compiling from Windows to Windows:

x86_64-windows-gnu target cranelift                                                                                                                                                                                   
Error: linking failed with: stdout: Compiler: cranelift                                                                                                                                                               
Target: x86_64-unknown-windows-gnu                                                                                                                                                                                    
Format: Symbols                                                                                                                                                                                                       
Using path `C:\Users\felix\wasmer\package\cache\wasmer-windows-gnu64\lib\libwasmer.a` as libwasmer path.                                                                                                              
                                                                                                                                                                                                                      
                                                                                                                                                                                                                      
stderr: C:\ProgramData\chocolatey\lib\zig\tools\zig-windows-x86_64-0.10.0\zig.exe clang C:\Users\felix\AppData\Local\Temp\.tmpnAprtL\wasmer_main.c -fno-caret-diagnostics -target x86_64-unknown-windows-gnu -nostdinc
 -fno-spell-checking -isystem C:\ProgramData\chocolatey\lib\zig\tools\zig-windows-x86_64-0.10.0\lib\include -isystem C:\ProgramData\chocolatey\lib\zig\tools\zig-windows-x86_64-0.10.0\lib\libc\include\x86_64-windows
-gnu -isystem C:\ProgramData\chocolatey\lib\zig\tools\zig-windows-x86_64-0.10.0\lib\libc\include\generic-mingw -isystem C:\ProgramData\chocolatey\lib\zig\tools\zig-windows-x86_64-0.10.0\lib\libc\include\x86_64-wind
ows-any -isystem C:\ProgramData\chocolatey\lib\zig\tools\zig-windows-x86_64-0.10.0\lib\libc\include\any-windows-any -Xclang -target-cpu -Xclang x86-64 -Xclang -target-feature -Xclang -16bit-mode -Xclang -target-fea
ture -Xclang -32bit-mode -Xclang -target-feature -Xclang -3dnow -Xclang -target-feature -Xclang -3dnowa -Xclang -target-feature -Xclang +64bit -Xclang -target-feature -Xclang -adx -Xclang -target-feature -Xclang -a
es -Xclang -target-feature -Xclang -amx-bf16 -Xclang -target-feature -Xclang -amx-int8 -Xclang -target-feature -Xclang -amx-tile -Xclang -target-feature -Xclang -avx -Xclang -target-feature -Xclang -avx2 -Xclang -t
arget-feature -Xclang -avx512bf16 -Xclang -target-feature -Xclang -avx512bitalg -Xclang -target-feature -Xclang -avx512bw -Xclang -target-feature -Xclang -avx512cd -Xclang -target-feature -Xclang -avx512dq -Xclang 
-target-feature -Xclang -avx512er -Xclang -target-feature -Xclang -avx512f -Xclang -target-feature -Xclang -avx512fp16 -Xclang -target-feature -Xclang -avx512ifma -Xclang -target-feature -Xclang -avx512pf -Xclang -
target-feature -Xclang -avx512vbmi -Xclang -target-feature -Xclang -avx512vbmi2 -Xclang -target-feature -Xclang -avx512vl -Xclang -target-feature -Xclang -avx512vnni -Xclang -target-feature -Xclang -avx512vp2inters
ect -Xclang -target-feature -Xclang -avx512vpopcntdq -Xclang -target-feature -Xclang -avxvnni -Xclang -target-feature -Xclang -bmi -Xclang -target-feature -Xclang -bmi2 -Xclang -target-feature -Xclang -branchfusion
 -Xclang -target-feature -Xclang -cldemote -Xclang -target-feature -Xclang -clflushopt -Xclang -target-feature -Xclang -clwb -Xclang -target-feature -Xclang -clzero -Xclang -target-feature -Xclang +cmov -Xclang -ta
rget-feature -Xclang -crc32 -Xclang -target-feature -Xclang -cx16 -Xclang -target-feature -Xclang +cx8 -Xclang -target-feature -Xclang -enqcmd -Xclang -target-feature -Xclang -ermsb -Xclang -target-feature -Xclang 
-f16c -Xclang -target-feature -Xclang -false-deps-getmant -Xclang -target-feature -Xclang -false-deps-lzcnt-tzcnt -Xclang -target-feature -Xclang -false-deps-mulc -Xclang -target-feature -Xclang -false-deps-mullq -
Xclang -target-feature -Xclang -false-deps-perm -Xclang -target-feature -Xclang -false-deps-popcnt -Xclang -target-feature -Xclang -false-deps-range -Xclang -target-feature -Xclang -fast-11bytenop -Xclang -target-f
eature -Xclang -fast-15bytenop -Xclang -target-feature -Xclang -fast-7bytenop -Xclang -target-feature -Xclang -fast-bextr -Xclang -target-feature -Xclang -fast-gather -Xclang -target-feature -Xclang -fast-hops -Xcl
ang -target-feature -Xclang -fast-lzcnt -Xclang -target-feature -Xclang -fast-movbe -Xclang -target-feature -Xclang -fast-scalar-fsqrt -Xclang -target-feature -Xclang -fast-scalar-shift-masks -Xclang -target-featur
e -Xclang -fast-shld-rotate -Xclang -target-feature -Xclang -fast-variable-crosslane-shuffle -Xclang -target-feature -Xclang -fast-variable-perlane-shuffle -Xclang -target-feature -Xclang -fast-vector-fsqrt -Xclang
 -target-feature -Xclang -fast-vector-shift-masks -Xclang -target-feature -Xclang -fma -Xclang -target-feature -Xclang -fma4 -Xclang -target-feature -Xclang -fsgsbase -Xclang -target-feature -Xclang -fsrm -Xclang -
target-feature -Xclang +fxsr -Xclang -target-feature -Xclang -gfni -Xclang -target-feature -Xclang -harden-sls-ijmp -Xclang -target-feature -Xclang -harden-sls-ret -Xclang -target-feature -Xclang -hreset -Xclang -t
arget-feature -Xclang -idivl-to-divb -Xclang -target-feature -Xclang +idivq-to-divl -Xclang -target-feature -Xclang -invpcid -Xclang -target-feature -Xclang -kl -Xclang -target-feature -Xclang -lea-sp -Xclang -targ
et-feature -Xclang -lea-uses-ag -Xclang -target-feature -Xclang -lvi-cfi -Xclang -target-feature -Xclang -lvi-load-hardening -Xclang -target-feature -Xclang -lwp -Xclang -target-feature -Xclang -lzcnt -Xclang -targ
et-feature -Xclang +macrofusion -Xclang -target-feature -Xclang +mmx -Xclang -target-feature -Xclang -movbe -Xclang -target-feature -Xclang -movdir64b -Xclang -target-feature -Xclang -movdiri -Xclang -target-featur
e -Xclang -mwaitx -Xclang -target-feature -Xclang +nopl -Xclang -target-feature -Xclang -pad-short-functions -Xclang -target-feature -Xclang -pclmul -Xclang -target-feature -Xclang -pconfig -Xclang -target-feature 
-Xclang -pku -Xclang -target-feature -Xclang -popcnt -Xclang -target-feature -Xclang -prefer-128-bit -Xclang -target-feature -Xclang -prefer-256-bit -Xclang -target-feature -Xclang -prefer-mask-registers -Xclang -t
arget-feature -Xclang -prefetchwt1 -Xclang -target-feature -Xclang -prfchw -Xclang -target-feature -Xclang -ptwrite -Xclang -target-feature -Xclang -rdpid -Xclang -target-feature -Xclang -rdpru -Xclang -target-feat
ure -Xclang -rdrnd -Xclang -target-feature -Xclang -rdseed -Xclang -target-feature -Xclang -retpoline -Xclang -target-feature -Xclang -retpoline-external-thunk -Xclang -target-feature -Xclang -retpoline-indirect-br
anches -Xclang -target-feature -Xclang -retpoline-indirect-calls -Xclang -target-feature -Xclang -rtm -Xclang -target-feature -Xclang -sahf -Xclang -target-feature -Xclang -sbb-dep-breaking -Xclang -target-feature 
-Xclang -serialize -Xclang -target-feature -Xclang -seses -Xclang -target-feature -Xclang -sgx -Xclang -target-feature -Xclang -sha -Xclang -target-feature -Xclang -shstk -Xclang -target-feature -Xclang +slow-3ops-
lea -Xclang -target-feature -Xclang +slow-incdec -Xclang -target-feature -Xclang -slow-lea -Xclang -target-feature -Xclang -slow-pmaddwd -Xclang -target-feature -Xclang -slow-pmulld -Xclang -target-feature -Xclang 
-slow-shld -Xclang -target-feature -Xclang -slow-two-mem-ops -Xclang -target-feature -Xclang -slow-unaligned-mem-16 -Xclang -target-feature -Xclang -slow-unaligned-mem-32 -Xclang -target-feature -Xclang -soft-float
 -Xclang -target-feature -Xclang +sse -Xclang -target-feature -Xclang +sse2 -Xclang -target-feature -Xclang -sse3 -Xclang -target-feature -Xclang -sse4.1 -Xclang -target-feature -Xclang -sse4.2 -Xclang -target-feat
ure -Xclang -sse4a -Xclang -target-feature -Xclang -sse-unaligned-mem -Xclang -target-feature -Xclang -ssse3 -Xclang -target-feature -Xclang -tagged-globals -Xclang -target-feature -Xclang -tbm -Xclang -target-feat
ure -Xclang -tsxldtrk -Xclang -target-feature -Xclang -uintr -Xclang -target-feature -Xclang -use-glm-div-sqrt-costs -Xclang -target-feature -Xclang -use-slm-arith-costs -Xclang -target-feature -Xclang -vaes -Xclan
g -target-feature -Xclang -vpclmulqdq -Xclang -target-feature -Xclang +vzeroupper -Xclang -target-feature -Xclang -waitpkg -Xclang -target-feature -Xclang -wbnoinvd -Xclang -target-feature -Xclang -widekl -Xclang -
target-feature -Xclang +x87 -Xclang -target-feature -Xclang -xop -Xclang -target-feature -Xclang -xsave -Xclang -target-feature -Xclang -xsavec -Xclang -target-feature -Xclang -xsaveopt -Xclang -target-feature -Xcl
ang -xsaves -Wno-pragma-pack -mred-zone -fomit-frame-pointer -fno-stack-protector -DNDEBUG -O2 -funwind-tables -gcodeview -MD -MV -MF C:\Users\felix\AppData\Local\zig\tmp\dfff3e6a2243a970-wasmer_main.obj.d -I C:\Us
ers\felix\AppData\Local\Temp\.tmpnAprtL\include -I C:\Users\felix\wasmer\package\cache\wasmer-windows-gnu64\include -c -o C:\Users\felix\AppData\Local\zig\tmp\dfff3e6a2243a970-wasmer_main.obj                       
lld-link -ERRORLIMIT:0 -NOLOGO -DEBUG -STACK:16777216 -MACHINE:X64 -INCLUDE:_tls_index -OUT:C:\Users\felix\AppData\Local\Temp\.tmpnAprtL\wasmer_main.exe -IMPLIB:C:\Users\felix\AppData\Local\Temp\.tmpnAprtL\wasmer_m
ain.lib C:\Users\felix\AppData\Local\Temp\.tmpnAprtL\atoms\python.o C:\Users\felix\AppData\Local\Temp\.tmpnAprtL\volumes\volume.o C:\Users\felix\wasmer\package\cache\wasmer-windows-gnu64\lib\libwasmer.a C:\Users\fe
lix\wasmer\package\cache\wasmer-windows-gnu64\winsdk\ADVAPI32.lib C:\Users\felix\wasmer\package\cache\wasmer-windows-gnu64\winsdk\BCRYPT.lib C:\Users\felix\wasmer\package\cache\wasmer-windows-gnu64\winsdk\KERNEL32.
lib C:\Users\felix\wasmer\package\cache\wasmer-windows-gnu64\winsdk\USERENV.lib C:\Users\felix\wasmer\package\cache\wasmer-windows-gnu64\winsdk\WS2_32.lib C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e3610
18b5fe54\wasmer_main.obj -lldmingw -ALTERNATENAME:__image_base__=__ImageBase C:\Users\felix\AppData\Local\zig\o\48af5ddab4e8f997dfa4c14ea5005f82\crt2.obj C:\Users\felix\AppData\Local\zig\o\0445965f49d5fd2da2727960e
32d1404\mingw32.lib C:\Users\felix\AppData\Local\zig\o\a16c0e115e5585a30924c2a45c58da05\mingwex.lib C:\Users\felix\AppData\Local\zig\o\04affbc1f98d63d3d2fe0f0213885f2d\msvcrt-os.lib C:\Users\felix\AppData\Local\zig
\o\87704c2a3ef1dfd645a38c6de082b066\advapi32.lib C:\Users\felix\AppData\Local\zig\o\6ea6398988874157b543ec6c0e760526\kernel32.lib C:\Users\felix\AppData\Local\zig\o\8869aaaa26f9fd370718fc79c7c92455\msvcrt.lib C:\Us
ers\felix\AppData\Local\zig\o\e0ca1e17029bc7872ac3d7daefc7095f\ntdll.lib C:\Users\felix\AppData\Local\zig\o\3c86093ac61037d31eaf8b0439a7a5b7\shell32.lib C:\Users\felix\AppData\Local\zig\o\d420b3033236ebc77d00e7d4dc
aa6457\user32.lib                                                                                                                                                                                                     
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_module_deserialize (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.13
.rcgu.o)) [LNK4217]                                                                                                                                                                                                   
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_config_new (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.13.rcgu.o)
) [LNK4217]                                                                                                                                                                                                           
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_engine_new_with_config (defined in libwasmer.a(wasmer.wasmer.427e55a0-cg
u.13.rcgu.o)) [LNK4217]                                                                                                                                                                                               
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_store_new (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.13.rcgu.o))
 [LNK4217]                                                                                                                                                                                                            
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_instance_new (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.14.rcgu.
o)) [LNK4217]                                                                                                                                                                                                         
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_instance_exports (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.14.r
cgu.o)) [LNK4217]                                                                                                                                                                                                     
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_extern_as_memory (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.8.rc
gu.o)) [LNK4217]                                                                                                                                                                                                      
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_func_call (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.10.rcgu.o))
 [LNK4217]                                                                                                                                                                                                            
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_trap_message (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.8.rcgu.o
)) [LNK4217]                                                                                                                                                                                                          
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_trap_delete (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.8.rcgu.o)
) [LNK4217]                                                                                                                                                                                                           
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_extern_vec_delete (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.8.r
cgu.o)) [LNK4217]                                                                                                                                                                                                     
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_instance_delete (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.14.rc
gu.o)) [LNK4217]                                                                                                                                                                                                      
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_module_delete (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.13.rcgu
.o)) [LNK4217]                                                                                                                                                                                                        
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_store_delete (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.13.rcgu.
o)) [LNK4217]                                                                                                                                                                                                         
lld-link: warning: C:\Users\felix\AppData\Local\zig\o\8ba359527eaab204f49e361018b5fe54\wasmer_main.obj: locally defined symbol imported: wasm_engine_delete (defined in libwasmer.a(wasmer.wasmer.427e55a0-cgu.13.rcgu
.o)) [LNK4217]                                                                                                                                                                                                        
lld-link: error: undefined symbol: _Unwind_Resume                                                                                                                                                                     
>>> referenced by libwasmer.a(wasmer.wasmer.427e55a0-cgu.9.rcgu.o):(_$LT$core..iter..adapters..map..Map$LT$I$C$F$GT$$u20$as$u20$core..iter..traits..iterator..Iterator$GT$::fold::h1c21c71bff7c2815)                  
>>> referenced by libwasmer.a(wasmer.wasmer.427e55a0-cgu.9.rcgu.o):(_$LT$core..iter..adapters..map..Map$LT$I$C$F$GT$$u20$as$u20$core..iter..traits..iterator..Iterator$GT$::fold::h4c08e499252a78ba)                  
>>> referenced by libwasmer.a(wasmer.wasmer.427e55a0-cgu.9.rcgu.o):(_$LT$core..iter..adapters..map..Map$LT$I$C$F$GT$$u20$as$u20$core..iter..traits..iterator..Iterator$GT$::fold::h6f15da45ac2d474f)                  
>>> referenced 6485 more times                                                                                                                                                                                        
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_GetTextRelBase                                                                                                                                                             
>>> referenced by library\panic_unwind\src/gcc.rs:311                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(core::ops::function::FnOnce::call_once$u7b$$u7b$vtable.shim$u7d$$u7d$::h120afaf66be0f181)                            
>>> referenced by library\panic_unwind\src/gcc.rs:311                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(panic_unwind::real_imp::find_eh_action::_$u7b$$u7b$closure$u7d$$u7d$::h5cbee68fbb2e54a5)                             
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_GetDataRelBase                                                                                                                                                             
>>> referenced by library\panic_unwind\src/gcc.rs:312                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(core::ops::function::FnOnce::call_once$u7b$$u7b$vtable.shim$u7d$$u7d$::h46860d7ddd1c529e)                            
>>> referenced by library\panic_unwind\src/gcc.rs:312                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(panic_unwind::real_imp::find_eh_action::_$u7b$$u7b$closure$u7d$$u7d$::h9dfe4c779f0c2792)                             
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_DeleteException                                                                                                                                                            
>>> referenced by library\panic_unwind\src/gcc.rs:78                                                                                                                                                                  
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(__rust_panic_cleanup)                                                                                                
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_RaiseException                                                                                                                                                             
>>> referenced by library\panic_unwind\src/gcc.rs:62                                                                                                                                                                  
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(__rust_start_panic)                                                                                                  
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_GetLanguageSpecificData                                                                                                                                                    
>>> referenced by library\panic_unwind\src/gcc.rs:303                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(panic_unwind::real_imp::rust_eh_personality_impl::hb352fbd3e44c33d1)                                                 
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_GetIPInfo                                                                                                                                                                  
>>> referenced by library\panic_unwind\src/gcc.rs:305                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(panic_unwind::real_imp::rust_eh_personality_impl::hb352fbd3e44c33d1)                                                 
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_GetRegionStart                                                                                                                                                             
>>> referenced by library\panic_unwind\src/gcc.rs:310                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(panic_unwind::real_imp::rust_eh_personality_impl::hb352fbd3e44c33d1)                                                 
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_SetGR                                                                                                                                                                      
>>> referenced by library\panic_unwind\src/gcc.rs:254                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(panic_unwind::real_imp::rust_eh_personality_impl::hb352fbd3e44c33d1)                                                 
>>> referenced by library\panic_unwind\src/gcc.rs:256                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(panic_unwind::real_imp::rust_eh_personality_impl::hb352fbd3e44c33d1)                                                 
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _Unwind_SetIP                                                                                                                                                                      
>>> referenced by library\panic_unwind\src/gcc.rs:257                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(panic_unwind::real_imp::rust_eh_personality_impl::hb352fbd3e44c33d1)                                                 
                                                                                                                                                                                                                      
lld-link: error: undefined symbol: _GCC_specific_handler                                                                                                                                                              
>>> referenced by library\panic_unwind\src/gcc.rs:276                                                                                                                                                                 
>>>               libwasmer.a(panic_unwind-abcb1ca87a57a92a.panic_unwind.6f51e6e7-cgu.0.rcgu.o):(rust_eh_personality)                                                                                                 
error: could not copy from C:\Users\felix\AppData\Local\Temp\.tmpnAprtL\wasmer_main.exe to C:\Users\felix\AppData\Local\Temp\.tmp7g3Pvd\x86_64-windows-gnu-python: The system cannot find the file specified. (os erro
r 2)                                                                                                                                                                                                                                                                                                                                                                                                                                   

This is because zig cannot build libunwind / libcxxabi on Windows when adding -lunwind to zig build-exe:

error(compilation): clang failed with stderr: zig: warning: argument unused during compilation: '-nostdinc++' [-Wunused-command-line-argument]
zig: warning: argument unused during compilation: '-nostdinc++' [-Wunused-command-line-argument]
In file included from C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/cxa_aux_runtime.cpp:14:
In file included from C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxx\include/typeinfo:76:
C:\Program Files (x86)\Microsoft Visual Studio\2019\Enterprise\VC\Tools\MSVC\14.29.30133\include/vcruntime_typeinfo.h:121:13: error: target of using declaration conflicts with declaration already in scope
C:\Program Files (x86)\Microsoft Visual Studio\[2019](https://github.com/wasmerio/wasmer/actions/runs/3824129197/jobs/6506132267#step:12:2020)\Enterprise\VC\Tools\MSVC\14.29.30133\include/vcruntime_typeinfo.h:69:7: note: target of using declaration
C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\include/cxxabi.h:30:27: note: conflicting declaration

error(compilation): C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/stdlib_typeinfo.cpp:1:1: unable to build C object: clang exited with code 1
error(compilation): C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/stdlib_new_delete.cpp:1:1: unable to build C object: clang exited with code 1
error(compilation): C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/stdlib_exception.cpp:1:1: unable to build C object: clang exited with code 1
error(compilation): C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/stdlib_stdexcept.cpp:1:1: unable to build C object: clang exited with code 1
error(compilation): C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/cxa_handlers.cpp:1:1: unable to build C object: clang exited with code 1
error(compilation): C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/cxa_guard.cpp:1:1: unable to build C object: clang exited with code 1
error(compilation): C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/cxa_exception.cpp:1:1: unable to build C object: clang exited with code 1
error(compilation): C:\hostedtoolcache\windows\zig\zig-windows-x86_64-0.10.0\x64\lib\libcxxabi\src/cxa_aux_runtime.cpp:1:1: unable to build C object: clang exited with code 1
error: unable to build libunwind: BuildingLibCObjectFailed
error: unable to build libcxxabi: BuildingLibCObjectFailed

We could work around this if we build windows-gnu/libwasmer.a without any panicking / unwinding support, in order to do this, you'd have to use:

RUSTFLAGS=-Cpanic=abort 
cargo +nightly build --release 
-Zbuild-std=std,panic_abort  
-Zbuild-std-features=panic_immediate_abort 
--target x86_64-pc-windows-gnu 
--manifest-path lib/c-api/Cargo.toml 
--no-default-features 
--features wat,compiler,wasi,middlewares,webc_runner 
--features cranelift,singlepass,wasmer-artifact-create,static-artifact-create,wasmer-artifact-load,static-artifact-load

... and then specify it with:

./target/release/wasmer create-exe ./lib/c-api/examples/assets/qjs.wasm 
-o ./js.exe 
--target x86_64-windows-gnu 
--use-wasmer-release https://github.com/wasmerio/wasmer/files/10337786/wasmer-gnu64-2.tar.gz

Currently it is somewhat cumbersome to add new Webassembly tests.

We should:

• Improve the workflow for adding Rust tests that compile to WASM

• Improve the workflow for adding WAT tests

• Document the process for adding and running new tests

In order to release a new version, we currently still use the old build.yaml file, which has the same steps as in the test.yaml file, except for the last "release" step, which is missing from test.yaml. The build.yaml is a lot slower than the test.yaml (45 minutes vs 20 minutes).

We should merge them into one workflow and copy the release step to the test.yaml.

Currently if we call wasm_func_call on the _start function, we need to have a way to check whether the exit code exited with 0, as it's currently the case for WASI.

own wasm_trap_t *trap = wasm_func_call(start_function, &args, &results);

This should be done in the 3.2.0-beta release so that we can link to the new API in the 3.2.0 release.