I am trying to run the Linux kernel version 5.15.71 available here https://github.com/projectacrn/acrn-kernel/tree/release_3.2 as a Service VM under ACRN hypervisor. I am mainly following their “Getting started” guide available here https://projectacrn.github.io/latest/try.html.
I have managed to run the hypervisor (I can see from the logs) but the Service VM is not starting. For some reason the Service VM kernel is panicking with the following message.
Kernel panic – not syncing: Fatal exception in interrupt
[ 26.083409] Kernel Offset: 0x13000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)
I have extensively searched on the internet and have tried several options but none seems to work. I know this might not be the right place to ask this question but since the issue is related to Linux kernel and ACRN itself does not have a large community, I am putting it here (already posted a question there few days ago and still waiting for a response).
Partial kernel log of the Service VM is given below with lines before the panic. My main question is what can be the potential reasons for kernel to panic and what should I try as a solution. Just for clarification, the hardware seems to be fine because I have several other kernels booting normally on the same hardware.
Thank you
[ 25.535394] input: Chicony HP Wired Desktop 320K Keyboard System Control as /devices/pci0000:00/0000:00:14.0/usb1/1-10/1-10:1.1/0003:04F2:3F41.0002/input/input5
[ 25.535788] hid-generic 0003:04F2:3F41.0002: input,hiddev0,hidraw1: USB HID v1.10 Device [Chicony HP Wired Desktop 320K Keyboard] on usb-0000:00:14.0-10/input1
[ 25.538119] input: PixArt HP 320M USB Optical Mouse as /devices/pci0000:00/0000:00:14.0/usb1/1-7/1-7.3/1-7.3:1.0/0003:0461:4141.0003/input/input6
[ 25.538481] hid-generic 0003:0461:4141.0003: input,hidraw2: USB HID v1.11 Mouse [PixArt HP 320M USB Optical Mouse] on usb-0000:00:14.0-7.3/input0
[ 25.538773] usbcore: registered new interface driver usbhid
[ 25.538895] usbhid: USB HID core driver
[ 25.539604] SBuf: ele_num=0x1fffe, ele_size=0x20 allocated!
[ 25.540129] SBuf: ele_num=0x1fffe, ele_size=0x20 allocated!
[ 25.540659] SBuf: ele_num=0x1fffe, ele_size=0x20 allocated!
[ 25.541192] SBuf: ele_num=0x1fffe, ele_size=0x20 allocated!
[ 25.541718] SBuf: ele_num=0x1fffe, ele_size=0x20 allocated!
[ 25.542244] SBuf: ele_num=0x1fffe, ele_size=0x20 allocated!
[ 25.542786] SBuf: ele_num=0x1fffe, ele_size=0x20 allocated!
[ 25.543305] SBuf: ele_num=0x1fffe, ele_size=0x20 allocated!
[ 25.543436] SBuf: setup phys add = 0xfb7c00000
[ 25.556176] SBuf: setup phys add = 0xfb7800000
[ 25.568945] SBuf: setup phys add = 0xfb7400000
[ 25.581689] SBuf: setup phys add = 0xfb7000000
[ 25.594465] SBuf: setup phys add = 0xfb6c00000
[ 25.607237] SBuf: setup phys add = 0xfb6800000
[ 25.619956] SBuf: setup phys add = 0xfb6400000
[ 25.632666] SBuf: setup phys add = 0xfb6000000
[ 25.645579] ACRNTrace: Initialized acrn trace module with 8 cpu
[ 25.645723] ACRN HVLog: no fixed memory reserve for hvlog.
[ 25.645884] SPI driver st-accel-spi has no spi_device_id for st,lis302dl-spi
[ 25.646055] SPI driver st-accel-spi has no spi_device_id for st,lis3lv02dl-accel
[ 25.646234] SPI driver st-accel-spi has no spi_device_id for st,lis3dh-accel
[ 25.646410] SPI driver st-accel-spi has no spi_device_id for st,lsm330d-accel
[ 25.646582] SPI driver st-accel-spi has no spi_device_id for st,lsm330dl-accel
[ 25.646757] SPI driver st-accel-spi has no spi_device_id for st,lsm330dlc-accel
[ 25.646934] SPI driver st-accel-spi has no spi_device_id for st,lis331dlh-accel
[ 25.647112] SPI driver st-accel-spi has no spi_device_id for st,lsm330-accel
[ 25.647282] SPI driver st-accel-spi has no spi_device_id for st,lsm303agr-accel
[ 25.647464] SPI driver st-accel-spi has no spi_device_id for st,lis2dh12-accel
[ 25.647639] SPI driver st-accel-spi has no spi_device_id for st,lng2dm-accel
[ 25.647809] SPI driver st-accel-spi has no spi_device_id for st,h3lis331dl-accel
[ 25.647987] SPI driver st-accel-spi has no spi_device_id for st,lis331dl-accel
[ 25.648170] SPI driver st-gyro-spi has no spi_device_id for st,l3g4200d-gyro
[ 25.648340] SPI driver st-gyro-spi has no spi_device_id for st,lsm330d-gyro
[ 25.648512] SPI driver st-gyro-spi has no spi_device_id for st,lsm330dl-gyro
[ 25.648681] SPI driver st-gyro-spi has no spi_device_id for st,lsm330dlc-gyro
[ 25.648852] SPI driver st-gyro-spi has no spi_device_id for st,l3gd20-gyro
[ 25.649017] SPI driver st-gyro-spi has no spi_device_id for st,l3gd20h-gyro
[ 25.649185] SPI driver st-gyro-spi has no spi_device_id for st,l3g4is-gyro
[ 25.649354] SPI driver st-gyro-spi has no spi_device_id for st,lsm330-gyro
[ 25.649520] SPI driver st-gyro-spi has no spi_device_id for st,lsm9ds0-gyro
[ 25.649769] SPI driver st-magn-spi has no spi_device_id for st,lis3mdl-magn
[ 25.649937] SPI driver st-magn-spi has no spi_device_id for st,lsm303agr-magn
[ 25.650110] SPI driver st-magn-spi has no spi_device_id for st,lsm9ds1-magn
[99478189us][cpu=4][vm0:vcpu4][sev=4][seq=165]:rdmsr_vmexit_handler(): vm0 vcpu4 reading MSR c0011020 not supported
[99490058us][cpu=4][vm0:vcpu4][sev=1][seq=166]:dispatch VM exit handler failed for reason 31, ret = -13!
cexe].53f+tpe 9630fne0
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? _prb_read_valid+0x84/0x2f0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? prb_read_valid+0x1c/0x30
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? search_exception_tables+0x3d/0x60
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? fixup_exception+0x23f/0x2f0
[ 26.045969] ? exc_general_protection+0xe3/0x4a0
[ 26.045969] ? asm_exc_general_protection+0x27/0x30
[ 26.045969] ? __restore_fpregs_from_fpstate+0x3a/0x50
[ 26.045969] ? switch_fpu_return+0x5a/0xf0
[ 26.045969] ? exit_to_user_mode_prepare+0x14b/0x170
[ 26.045969] ? call_usermodehelper_exec_work+0xd0/0xd0
[ 26.045969] ? syscall_exit_to_user_mode+0x28/0x60
[ 26.045969] ? ret_from_fork+0x15/0x30
[ 26.045969] </TASK>
[ 26.045969] Modules linked in:
[ 26.081354] ---[ end trace fdb00a55f0a72226 ]---
[ 26.083409] RIP: 0010:exc_general_protection+0x26/0x4a0
[ 26.083409] Code: ba 0f 1f 00 55 48 89 e5 41 57 41 56 41 55 49 89 f5 41 54 49 89 fc 53 48 83 ec 70 65 48 8b 04 25 28 00 00 00 48 89 45 d0 31 c0 <e8> e5 38 00 00 48 c7 45 8c 00 00 00 00 41 f6 84 24 912
[ 26.083409] RSP: 0000:ffffa3b68048ffc0 EFLAGS: 00010046
[ 26.083409] RAX: 0000000000000000 RBX: 0000000000000000 RCX: ffffffff95200eb0
[ 26.083409] RDX: 0000000000000000 RSI: 0000000000000000 RDI: ffffa3b680490068
[ 26.083409] RBP: ffffa3b680490058 R08: 0000000000000000 R09: 0000000000000000
[ 26.083409] R10: 0000000000000000 R11: 0000000000000000 R12: ffffa3b680490068
[ 26.083409] R13: 0000000000000000 R14: 0000000000000000 R15: 0000000000000000
[ 26.083409] FS: 0000000000000000(0000) GS:ffff9431f7a40000(0000) knlGS:0000000000000000
[ 26.083409] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[ 26.083409] CR2: ffffa3b68048ffb8 CR3: 00000001047bb004 CR4: 0000000000770ee0
[ 26.083409] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
[ 26.083409] DR3: 0000000000000000 DR6: 00000000fffe07f0 DR7: 0000000000000400
[ 26.083409] PKRU: 55555554
[ 26.083409] Kernel panic - not syncing: Fatal exception in interrupt
[ 26.083409] Kernel Offset: 0x13000000 from 0xffffffff81000000 (relocation range: 0xffffffff80000000-0xffffffffbfffffff)