Native abort (SIGABRT, exit 134) in JIT/SIMD/Vector3Interop_r on Linux x64

[matouskozak]

Note: This issue was automatically generated by AI-Test-Triage. Please review and triage accordingly.

Build Information

Build: 20260201.2, 20260202.1, 20260202.5, 20260203.1

Build error leg or test failing: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd, JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd

Affected CI jobs: build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests

Causing Commit Range Information

Commit range: {TODO: Insert commit range or link to changes}

Summary

• Native process aborted (SIGABRT) during test execution; child exit code 134 reported (Actual: 134).
• Failure on Linux x64 in job build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests.
• Console shows 'Aborted (core dumped)' and an External Debugger Dump; launcher returned 'Return code: 1'.
• Failure occurred while running out-of-process test runner (TestLibrary.OutOfProcessTest.RunOutOfProcessTest).
• No managed exception or in-test assertion trace shown; harness failed due to child process abort.

Failure Statistics

Note: These statistics are based on the configured time range and might not reflect the full history of the failure.

• Occurrence Count: 8
• First Failure: 2026-02-01 23:51:15 UTC
• Last Failure: 2026-02-03 12:06:42 UTC

Work Items

Work Item	Console Log	Build	Job Name
JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd	View Extract 23:49:55.930 Running test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd ================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/B4EE09C5/w/BE940A4D/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_r/Vector3Interop_r.sh: line 426: 38586 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}" Return code: 1 Raw output file: /datadisks/disk1/work/B4EE09C5/w/BE940A4D/uploads/Vector3Interop_r/output.txt Raw output: BEGIN EXECUTION ... Actual: 134 END EXECUTION - FAILED Test Harness Exitcode is : 1 at Xunit.Assert.True(Nullable`1 condition, String userMessage) at Xunit.Assert.True(Boolean condition, String userMessage) at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor100|0_101(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&) 23:50:03.761 Failed test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd Full Log	20260201.2	build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests
JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd	View Extract END EXECUTION - FAILED Test Harness Exitcode is : 1 To run the test: Set up CORE_ROOT and run. > /datadisks/disk1/work/B4EE09C5/w/BE940A4D/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_r/Vector3Interop_r.sh at Xunit.Assert.True(Nullable`1 condition, String userMessage) at Xunit.Assert.True(Boolean condition, String userMessage) at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor100|0_101(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&) 23:50:03.761 Failed test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd 23:50:03.761 Running test: JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd ================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/B4EE09C5/w/BE940A4D/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_ro/Vector3Interop_ro.sh: line 426: 38692 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}" Return code: 1 Raw output file: /datadisks/disk1/work/B4EE09C5/w/BE940A4D/uploads/Vector3Interop_ro/output.txt Raw output: BEGIN EXECUTION ... Actual: 134 END EXECUTION - FAILED Test Harness Exitcode is : 1 Full Log	20260201.2	build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests
JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd	View Extract 11:10:45.824 Running test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd ================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/C2E209F9/w/B40509AD/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_r/Vector3Interop_r.sh: line 426: 45699 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}" Return code: 1 Raw output file: /datadisks/disk1/work/C2E209F9/w/B40509AD/uploads/Vector3Interop_r/output.txt Raw output: BEGIN EXECUTION ... Actual: 134 END EXECUTION - FAILED Test Harness Exitcode is : 1 To run the test: Set up CORE_ROOT and run. > /datadisks/disk1/work/C2E209F9/w/B40509AD/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_r/Vector3Interop_r.sh at Xunit.Assert.True(Nullable`1 condition, String userMessage) at Xunit.Assert.True(Boolean condition, String userMessage) at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor100|0_101(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&) 11:10:53.124 Failed test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd Full Log	20260202.1	build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests
JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd	View Extract 11:10:53.125 Running test: JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd ================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/C2E209F9/w/B40509AD/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_ro/Vector3Interop_ro.sh: line 426: 45717 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}" Return code: 1 Raw output file: /datadisks/disk1/work/C2E209F9/w/B40509AD/uploads/Vector3Interop_ro/output.txt Raw output: BEGIN EXECUTION ... Actual: 134 END EXECUTION - FAILED Test Harness Exitcode is : 1 To run the test: Set up CORE_ROOT and run. > /datadisks/disk1/work/C2E209F9/w/B40509AD/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_ro/Vector3Interop_ro.sh at Xunit.Assert.True(Nullable`1 condition, String userMessage) at Xunit.Assert.True(Boolean condition, String userMessage) at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) 11:10:57.455 Failed test: JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd Full Log	20260202.1	build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests
JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd	View Extract 06:20:11.884 Running test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd ================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/B1DE096D/w/C3EC0A11/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_r/Vector3Interop_r.sh: line 426: 9949 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}" Return code: 1 Raw output file: /datadisks/disk1/work/B1DE096D/w/C3EC0A11/uploads/Vector3Interop_r/output.txt Raw output: BEGIN EXECUTION ... Actual: 134 END EXECUTION - FAILED Test Harness Exitcode is : 1 at Xunit.Assert.True(Nullable`1 condition, String userMessage) at Xunit.Assert.True(Boolean condition, String userMessage) at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor100|0_101(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&) 06:20:16.777 Failed test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd Full Log	20260202.5	build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests
JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd	View Extract at Xunit.Assert.True(Boolean condition, String userMessage) at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor100|0_101(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&) 06:20:16.777 Failed test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd 06:20:16.778 Running test: JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd ================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/B1DE096D/w/C3EC0A11/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_ro/Vector3Interop_ro.sh: line 426: 9965 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}" Return code: 1 Raw output file: /datadisks/disk1/work/B1DE096D/w/C3EC0A11/uploads/Vector3Interop_ro/output.txt Raw output: BEGIN EXECUTION ... Actual: 134 END EXECUTION - FAILED Test Harness Exitcode is : 1 Full Log	20260202.5	build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests
JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd	View Extract 12:05:05.279 Running test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd ================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/BAE50A92/w/9F020891/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_r/Vector3Interop_r.sh: line 426: 2977 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}" Return code: 1 Raw output file: /datadisks/disk1/work/BAE50A92/w/9F020891/uploads/Vector3Interop_r/output.txt Raw output: BEGIN EXECUTION ... Actual: 134 END EXECUTION - FAILED Test Harness Exitcode is : 1 at Xunit.Assert.True(Nullable`1 condition, String userMessage) at Xunit.Assert.True(Boolean condition, String userMessage) Full Log	20260203.1	build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests
JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd	View Extract END EXECUTION - FAILED Test Harness Exitcode is : 1 To run the test: Set up CORE_ROOT and run. > /datadisks/disk1/work/BAE50A92/w/9F020891/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_r/Vector3Interop_r.sh at Xunit.Assert.True(Nullable`1 condition, String userMessage) at Xunit.Assert.True(Boolean condition, String userMessage) at TestLibrary.OutOfProcessTest.RunOutOfProcessTest(String assemblyPath, String testPathPrefix) at Program.<<Main>$>g__TestExecutor100|0_101(StreamWriter tempLogSw, StreamWriter statsCsvSw, <>c__DisplayClass0_0&) 12:05:11.330 Failed test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd 12:05:11.331 Running test: JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd ================================================================= External Debugger Dump: ================================================================= /datadisks/disk1/work/BAE50A92/w/9F020891/e/JIT/SIMD/JIT.SIMD/../Vector3Interop_ro/Vector3Interop_ro.sh: line 426: 2995 Aborted (core dumped) $LAUNCHER $ExePath "${CLRTestExecutionArguments[@]}" Return code: 1 Raw output file: /datadisks/disk1/work/BAE50A92/w/9F020891/uploads/Vector3Interop_ro/output.txt Raw output: BEGIN EXECUTION ... Actual: 134 END EXECUTION - FAILED Test Harness Exitcode is : 1 Full Log	20260203.1	build_linux_x64_Release_AllSubsets_Mono_LLVMFullAot_RuntimeIntrinsicsTests

Error Message

{
  "ErrorMessage": [
      "Failed test: JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd",
      "Actual: 134"
  ],
  "BuildRetry": false,
  "ExcludeConsoleLog": false
}

Report

Build	Repository	Test	Pull Request
1424351	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1424079	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1423931	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1423672	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1423593	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1423504	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1423166	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1423053	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1422745	dotnet/runtime	JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd
1422120	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd	#127498
1421640	dotnet/runtime	JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd
1420216	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1420047	dotnet/runtime	JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd
1419596	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1418805	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd	#124173
1418956	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd	#125437
1418532	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1418286	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1417616	dotnet/runtime	JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd	#125437
1417792	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1416947	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1416787	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1416309	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1415929	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd	#125437
1415344	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1415126	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd
1414961	dotnet/runtime	JIT/SIMD/Vector3Interop_ro/Vector3Interop_ro.cmd
1414764	dotnet/runtime	JIT/SIMD/Vector3Interop_r/Vector3Interop_r.cmd

Summary

24-Hour Hit Count	7-Day Hit Count	1-Month Count
0	0	28

[danmoseley]

Note

This analysis was generated by GitHub Copilot using the ci-crash-dump skill (under development).

Crash Dump Analysis

Build: 20260322.1 (most recent)
CI job: build_linux_x64_Release_AllSubsets_Mono_LLVMFULLAOT_RuntimeIntrinsicsTests
Helix job: 6580549d-56b8-4344-b130-47d8698872e3, work item JIT.SIMD
Machine: a009WQA, Azure Linux 3 x86_64, glibc 2.38
Crashed tests: Vector3Interop_r (PID 5067) and Vector3Interop_ro (PID 5079) — identical crashes
Core dumps: core.1000.5067, core.1000.5079 (both ELF 64-bit x86-64)

Exit Code

134 (128 + 6 = SIGABRT) — deliberate process abort. The instruction at the crash point is immediately after a sys_tgkill syscall, confirming libc's raise(SIGABRT) → abort() path.

Crashing Thread Call Stack

4 threads in the core dump, all received signal 6 (SIGABRT). Thread 1 is the crashing thread.

Symbols resolved from libcoreclr.so .dynsym table (14,618 exported symbols; binary is stripped — internal/static functions bracketed by nearest exports, marked ~):

Thread 1 (crashed, signal=6 SIGABRT):

  corerun!_start+0x2a
  libc.so.6!__libc_start_call_main
  corerun!main
  corerun!(run_assembly)
✓ libcoreclr.so!monovm_execute_assembly+0x97
✓ libcoreclr.so!mono_main+0x184f
~ libcoreclr.so!(internal, between mono_assembly_open_full and mono_assembly_open)
~ libcoreclr.so!(internal, between mono_assembly_open_full and mono_assembly_open)
~ libcoreclr.so!(internal, between mono_aot_register_module and mono_wasm_install_get_native_to_interp_tramp)
~ libcoreclr.so!(internal @ 0x782e6e, in mini-runtime/aot-runtime region)
~ libcoreclr.so!(internal @ 0x782d36, in mini-runtime/aot-runtime region)
~ libcoreclr.so!(internal, between mono_dl_fallback_unregister and mono_bitset_alloc_size)
~ libcoreclr.so!(internal @ 0x782984, in mini-runtime/aot-runtime region)
  ─── SIGABRT ───
  libc.so.6!raise → tgkill(sig=6)
~ libcoreclr.so!(signal handler, between mono_arch_setup_resume_sighandler_ctx and mono_ee_interp_init)
~ libcoreclr.so!(crash reporter, near mono_print_thread_dump)
~ libcoreclr.so!(crash dump writer, between mono_arch_setup_resume_sighandler_ctx and mono_ee_interp_init)

Full debug symbols (.dbg) were not available on the Microsoft public symbol server for this CI build (build-id e3d0b80181a0fbd619659dafb1bb73000efeb144). The ~ frames in the 0x782xxx range are internal static functions in Mono's mini/aot-runtime.c (likely load_aot_module() and related AOT loading code).

Managed Exception: None. The managed stacktrace section in Mono's crash report is empty — the crash occurred during native AOT module loading, before any managed code executed.

Diagnosis

The console log shows this error immediately before the abort:

Failed to load AOT module
  '/datadisks/disk1/work/.../Vector3Interop_r/Vector3Interop_r.dll.so'
  ('/datadisks/disk1/work/.../Vector3Interop_r/Vector3Interop_r.dll')
  in aot-only mode.

Crash sequence:

1. Mono is configured with MONO_ENV_OPTIONS=--full-aot and DOTNET_RUNTIME_VARIANT=llvmfullaot (no JIT fallback)
2. corerun invokes monovm_execute_assembly → mono_main to run Vector3Interop_r.dll
3. Mono's assembly loader attempts to open the precompiled AOT native image (Vector3Interop_r.dll.so)
4. The .dll.so file does not exist on disk — confirmed by the core dump's NT_FILE mapped files list, which shows Vector3Interop_r.dll loaded but no corresponding Vector3Interop_r.dll.so
5. In --full-aot mode, JIT compilation is forbidden, so there is no fallback
6. Mono treats this as a fatal error and calls abort() → SIGABRT → core dump

This is not a runtime execution bug. It is an AOT compilation pipeline issue: the Vector3Interop_r and Vector3Interop_ro tests were never AOT-compiled into .dll.so files, or the AOT compilation silently failed. These tests use P/Invoke with a native C++ library for Vector3 interop, which may be incompatible with Mono's LLVM Full AOT compilation. All other SIMD tests in the same work item (AbsGeneric, AbsSqrt, AddingSequence, etc.) pass successfully — they don't use native C++ interop.

The issue has been failing consistently since February 2026 across 70+ builds.

Suggested Fix

1. Exclude Vector3Interop_r / Vector3Interop_ro from the LLVM Full AOT test leg (these tests rely on C++ native interop that may not be AOT-compatible)
2. Fix the AOT compilation pipeline to produce .dll.so for these tests — investigate why the LLVM AOT compiler fails or skips them
3. Change the test configuration to not use --full-aot for interop tests (use --aot with JIT fallback instead)