Skip to content

Hangs during scrub on debian 13.5 #18748

Description

@the8472

System information

Type Version/Name
Distribution Name Debian Trixie
Distribution Version 13.5
Kernel Version 6.12.94+deb13-amd64
Architecture x86-64
OpenZFS Version zfs-2.4.3-1~bpo13+1

Describe the problem you're observing

I'm seeing kernel oops during scrubs, with varying stacktraces. Eventually the scrub hangs, requiring a system restart. After reboot it makes some progress until it hangs again.

As far as I can tell this started happening after a recent debian minor release update bringing in new kernel and zfs versions.

Describe how to reproduce the problem

Include any warning/errors/backtraces from the system logs

dmsg oops
[167013.160968] Oops: general protection fault, probably for non-canonical address 0xd3be4ae4168da05c: 0000 [#1] PREEMPT SMP PTI
[167013.161013] CPU: 0 UID: 0 PID: 147354 Comm: dsl_scan_iss Tainted: P           OE      6.12.94+deb13-amd64 #1  Debian 6.12.94-1
[167013.161055] Tainted: [P]=PROPRIETARY_MODULE, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[167013.161085] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z87 Extreme6, BIOS P2.20 11/25/2013
[167013.161121] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[167013.161150] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[167013.161202] RSP: 0018:ffffcacc2bb8b900 EFLAGS: 00010286
[167013.161230] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 000000000000002e
[167013.161260] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[167013.161291] RBP: ffffcacc2bb8b938 R08: 00000016ce09d000 R09: 00000016ce09d000
[167013.161321] R10: fffffffffffffffe R11: 0000000000007000 R12: ffff890c4e1e6900
[167013.161351] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[167013.161408] FS:  0000000000000000(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[167013.161466] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[167013.161507] CR2: 000000063f1b3000 CR3: 00000006dea22001 CR4: 00000000000726f0
[167013.161563] Call Trace:
[167013.161598]  <TASK>
[167013.161634]  spl_kmem_cache_alloc+0x8b/0x600 [spl]
[167013.161687]  ? spl_kmem_zalloc+0x114/0x120 [spl]
[167013.161734]  abd_alloc_struct_impl+0x1b/0x40 [zfs]
[167013.161968]  abd_alloc_linear+0x1a/0xf0 [zfs]
[167013.162154]  vdev_raidz_map_alloc+0x223/0x5e0 [zfs]
[167013.162356]  vdev_raidz_io_start+0x6a7/0x7b0 [zfs]
[167013.162562]  zio_vdev_io_start+0x100/0x350 [zfs]
[167013.162752]  zio_nowait+0xd7/0x1d0 [zfs]
[167013.162940]  vdev_mirror_io_start+0x18e/0x240 [zfs]
[167013.163138]  zio_vdev_io_start+0x2b9/0x350 [zfs]
[167013.163320]  zio_nowait+0xd7/0x1d0 [zfs]
[167013.163498]  scan_io_queue_issue+0x1ae/0x330 [zfs]
[167013.163709]  scan_io_queues_run_one+0x480/0x980 [zfs]
[167013.163921]  taskq_thread+0x355/0x6f0 [spl]
[167013.163969]  ? __pfx_default_wake_function+0x10/0x10
[167013.164010]  ? __pfx_taskq_thread+0x10/0x10 [spl]
[167013.164052]  kthread+0xd2/0x100
[167013.164087]  ? __pfx_kthread+0x10/0x10
[167013.164123]  ret_from_fork+0x34/0x50
[167013.164159]  ? __pfx_kthread+0x10/0x10
[167013.164194]  ret_from_fork_asm+0x1a/0x30
[167013.164231]  </TASK>
[167013.164263] Modules linked in: sunrpc binfmt_misc bridge stp llc intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp zfs(POE) coretemp kvm_intel iTCO_wdt intel_pmc_bxt iTCO_vendor_support watchdog kvm mei_hdcp mei_pxp at24 snd_hda_codec_realtek snd_hda_codec_generic snd_hda_scodec_component snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec drm_buddy drm_display_helper snd_hda_core irqbypass snd_hwdep igb cec e1000e rapl snd_pcm intel_cstate rc_core nls_ascii intel_uncore nls_cp437 vfat fat vga16fb ttm snd_timer lpc_ich spl(OE) mxm_wmi i2c_i801 mei_me pcspkr vgastate mei dca i2c_smbus drm_kms_helper snd soundcore intel_smartconnect i2c_algo_bit button joydev evdev sg tcp_bbr drm efi_pstore configfs nfnetlink ip_tables x_tables sd_mod hid_generic usbhid hid ahci libahci libata ehci_pci xhci_pci ehci_hcd crct10dif_pclmul xhci_hcd crc32_pclmul ghash_clmulni_intel usbcore cryptd sha512_ssse3 sha256_ssse3 scsi_mod sha1_ssse3 scsi_common usb_common video wmi btrfs blake2b_generic libcrc32c
[167013.164324]  crc32c_generic crc32c_intel xor raid6_pq loop msr autofs4
[167013.164769] ---[ end trace 0000000000000000 ]---
[167013.164808] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[167013.164847] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[167013.164937] RSP: 0018:ffffcacc2bb8b900 EFLAGS: 00010286
[167013.164976] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 000000000000002e
[167013.165030] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[167013.165084] RBP: ffffcacc2bb8b938 R08: 00000016ce09d000 R09: 00000016ce09d000
[167013.165138] R10: fffffffffffffffe R11: 0000000000007000 R12: ffff890c4e1e6900
[167013.165192] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[167013.165246] FS:  0000000000000000(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[167013.165303] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[167013.165341] CR2: 000000063f1b3000 CR3: 00000006dea22001 CR4: 00000000000726f0
[167013.172157] Oops: general protection fault, probably for non-canonical address 0xd3be4ae4168da05c: 0000 [#2] PREEMPT SMP PTI
[167013.172230] CPU: 0 UID: 110 PID: 2190 Comm: transmission-da Tainted: P      D    OE      6.12.94+deb13-amd64 #1  Debian 6.12.94-1
[167013.172299] Tainted: [P]=PROPRIETARY_MODULE, [D]=DIE, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[167013.172360] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z87 Extreme6, BIOS P2.20 11/25/2013
[167013.172423] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[167013.172467] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[167013.172560] RSP: 0018:ffffcacc012bf4f0 EFLAGS: 00010286
[167013.172603] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 0000000000000000
[167013.172661] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[167013.172719] RBP: ffffcacc012bf530 R08: 000000003fffffff R09: 000000001c180000
[167013.172775] R10: ffff890ec3c431e0 R11: 00000000ffffffff R12: ffff890c4e1e6900
[167013.172832] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[167013.172889] FS:  00007fb1eb7ff6c0(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[167013.172948] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[167013.172989] CR2: 000000063f1bc000 CR3: 0000000100bbe004 CR4: 00000000000726f0
[167013.173046] Call Trace:
[167013.173080]  <TASK>
[167013.173116]  ? aggsum_add+0x16d/0x180 [zfs]
[167013.173339]  spl_kmem_cache_alloc+0x8b/0x600 [spl]
[167013.173387]  ? spl_kmem_cache_alloc+0x10d/0x600 [spl]
[167013.173430]  ? abd_copy_to_buf_off+0x3a/0x60 [zfs]
[167013.173615]  ? arc_buf_fill+0x4b0/0xb90 [zfs]
[167013.173800]  ? mutex_lock+0x12/0x30
[167013.173839]  ? mutex_lock+0x12/0x30
[167013.173876]  abd_alloc_struct_impl+0x1b/0x40 [zfs]
[167013.174066]  abd_alloc+0x35/0xf0 [zfs]
[167013.174246]  arc_hdr_alloc_abd+0x136/0x190 [zfs]
[167013.174426]  arc_read+0xb09/0x1760 [zfs]
[167013.174608]  ? __pfx_dbuf_issue_final_prefetch_done+0x10/0x10 [zfs]
[167013.174795]  ? arc_access+0x295/0x4a0 [zfs]
[167013.174974]  dbuf_issue_final_prefetch+0x7f/0x110 [zfs]
[167013.175164]  dbuf_prefetch_impl+0x779/0x7f0 [zfs]
[167013.175351]  ? __pfx_dmu_zfetch_done+0x10/0x10 [zfs]
[167013.175552]  dmu_zfetch_run+0x191/0x310 [zfs]
[167013.175750]  dmu_buf_hold_array_by_dnode+0x2a6/0x730 [zfs]
[167013.175944]  dmu_read_uio_dnode+0x72/0x190 [zfs]
[167013.176135]  ? filemap_range_has_page+0xbc/0xe0
[167013.176174]  zfs_read+0x4b6/0x650 [zfs]
[167013.176361]  zpl_iter_read+0xf0/0x190 [zfs]
[167013.176529]  vfs_read+0x247/0x360
[167013.176567]  __x64_sys_pread64+0x98/0xd0
[167013.176603]  do_syscall_64+0x87/0x1b0
[167013.176639]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.176681]  ? syscall_exit_to_user_mode+0x37/0x1b0
[167013.176720]  ? do_syscall_64+0x93/0x1b0
[167013.176755]  ? do_syscall_64+0x93/0x1b0
[167013.176792]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.176832]  ? syscall_exit_to_user_mode+0x37/0x1b0
[167013.176870]  ? do_syscall_64+0x93/0x1b0
[167013.176906]  ? __sys_sendto+0x1ce/0x1e0
[167013.176942]  ? __sys_sendto+0x139/0x1e0
[167013.176979]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.177019]  ? syscall_exit_to_user_mode+0x37/0x1b0
[167013.177057]  ? do_syscall_64+0x93/0x1b0
[167013.177093]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.177133]  ? syscall_exit_to_user_mode+0x37/0x1b0
[167013.177171]  ? do_syscall_64+0x93/0x1b0
[167013.177206]  ? do_syscall_64+0x93/0x1b0
[167013.177241]  ? do_syscall_64+0x93/0x1b0
[167013.177277]  ? do_syscall_64+0x93/0x1b0
[167013.177312]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.177352]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
[167013.177392] RIP: 0033:0x7fb1ec6a69ee
[167013.177437] Code: 08 0f 85 f5 4b ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 <c3> 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 80 00 00 00 00 48 83 ec 08
[167013.177529] RSP: 002b:00007fb1eb7ed888 EFLAGS: 00000246 ORIG_RAX: 0000000000000011
[167013.177588] RAX: ffffffffffffffda RBX: 00007fb1eb7ff6c0 RCX: 00007fb1ec6a69ee
[167013.177645] RDX: 0000000000004000 RSI: 00007fb1eb7ede20 RDI: 0000000000000018
[167013.177700] RBP: 00007fb1eb7edce0 R08: 0000000000000000 R09: 0000000000000000
[167013.177754] R10: 00000000016bee43 R11: 0000000000000246 R12: 00007fb1eb7ed950
[167013.177808] R13: 00007fb1eb7ede20 R14: 0000000000004000 R15: 00007fb1eb7edce0
[167013.177863]  </TASK>
[167013.177895] Modules linked in: sunrpc binfmt_misc bridge stp llc intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp zfs(POE) coretemp kvm_intel iTCO_wdt intel_pmc_bxt iTCO_vendor_support watchdog kvm mei_hdcp mei_pxp at24 snd_hda_codec_realtek snd_hda_codec_generic snd_hda_scodec_component snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec drm_buddy drm_display_helper snd_hda_core irqbypass snd_hwdep igb cec e1000e rapl snd_pcm intel_cstate rc_core nls_ascii intel_uncore nls_cp437 vfat fat vga16fb ttm snd_timer lpc_ich spl(OE) mxm_wmi i2c_i801 mei_me pcspkr vgastate mei dca i2c_smbus drm_kms_helper snd soundcore intel_smartconnect i2c_algo_bit button joydev evdev sg tcp_bbr drm efi_pstore configfs nfnetlink ip_tables x_tables sd_mod hid_generic usbhid hid ahci libahci libata ehci_pci xhci_pci ehci_hcd crct10dif_pclmul xhci_hcd crc32_pclmul ghash_clmulni_intel usbcore cryptd sha512_ssse3 sha256_ssse3 scsi_mod sha1_ssse3 scsi_common usb_common video wmi btrfs blake2b_generic libcrc32c
[167013.177956]  crc32c_generic crc32c_intel xor raid6_pq loop msr autofs4
[167013.178402] ---[ end trace 0000000000000000 ]---
[167013.178439] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[167013.178478] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[167013.178569] RSP: 0018:ffffcacc2bb8b900 EFLAGS: 00010286
[167013.178607] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 000000000000002e
[167013.179162] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[167013.179218] RBP: ffffcacc2bb8b938 R08: 00000016ce09d000 R09: 00000016ce09d000
[167013.179272] R10: fffffffffffffffe R11: 0000000000007000 R12: ffff890c4e1e6900
[167013.179326] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[167013.179382] FS:  00007fb1eb7ff6c0(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[167013.179440] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[167013.179483] CR2: 000000063f1bc000 CR3: 0000000100bbe004 CR4: 00000000000726f0
[167013.306056] Oops: general protection fault, probably for non-canonical address 0xd3be4ae4168da05c: 0000 [#3] PREEMPT SMP PTI
[167013.306153] CPU: 0 UID: 1000 PID: 132396 Comm: AEThread2:parke Tainted: P      D    OE      6.12.94+deb13-amd64 #1  Debian 6.12.94-1
[167013.306246] Tainted: [P]=PROPRIETARY_MODULE, [D]=DIE, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[167013.306323] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z87 Extreme6, BIOS P2.20 11/25/2013
[167013.306404] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[167013.306461] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[167013.306585] RSP: 0018:ffffcacc4018b410 EFLAGS: 00010286
[167013.306638] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 0000000000000000
[167013.306713] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[167013.306787] RBP: ffffcacc4018b448 R08: 000000003fffffff R09: 000000001c1a0000
[167013.306862] R10: ffff891279e02b40 R11: 00000000ffffffff R12: ffff890c4e1e6900
[167013.306936] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[167013.307011] FS:  00007f48a2c456c0(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[167013.307089] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[167013.307142] CR2: 000000063f28981c CR3: 000000012b56c003 CR4: 00000000000726f0
[167013.307217] Call Trace:
[167013.307261]  <TASK>
[167013.307307]  spl_kmem_cache_alloc+0x8b/0x600 [spl]
[167013.307377]  ? spl_kmem_cache_alloc+0x10d/0x600 [spl]
[167013.307438]  ? update_load_avg+0x7e/0x7b0
[167013.307491]  ? sugov_update_single_freq+0x81/0x230
[167013.307544]  ? mutex_lock+0x12/0x30
[167013.307594]  ? mutex_lock+0x12/0x30
[167013.307645]  abd_alloc_struct_impl+0x1b/0x40 [zfs]
[167013.308054]  abd_alloc+0x35/0xf0 [zfs]
[167013.308409]  arc_hdr_alloc_abd+0x136/0x190 [zfs]
[167013.308768]  arc_read+0xb09/0x1760 [zfs]
[167013.309126]  ? __pfx_dbuf_read_done+0x10/0x10 [zfs]
[167013.309500]  dbuf_read_impl.constprop.0+0x44d/0x790 [zfs]
[167013.309875]  dbuf_read+0x2d3/0x6b0 [zfs]
[167013.310244]  dmu_buf_hold_array_by_dnode+0x118/0x730 [zfs]
[167013.310632]  dmu_read_uio_dnode+0x72/0x190 [zfs]
[167013.311015]  ? filemap_range_has_page+0xbc/0xe0
[167013.311069]  zfs_read+0x4b6/0x650 [zfs]
[167013.311443]  zpl_iter_read+0xf0/0x190 [zfs]
[167013.311776]  do_iter_readv_writev+0x1c2/0x220
[167013.311831]  vfs_readv+0x1bc/0x2e0
[167013.311882]  ? tomoyo_path_perm+0xa8/0x200
[167013.311935]  ? do_readv+0x7e/0x150
[167013.311984]  do_readv+0x7e/0x150
[167013.312033]  do_syscall_64+0x87/0x1b0
[167013.312085]  ? __do_sys_newfstat+0x68/0x70
[167013.312137]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.312196]  ? syscall_exit_to_user_mode+0x37/0x1b0
[167013.312250]  ? do_syscall_64+0x93/0x1b0
[167013.312299]  ? zpl_llseek+0x33/0x120 [zfs]
[167013.312629]  ? mutex_lock+0x12/0x30
[167013.312679]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.312736]  ? syscall_exit_to_user_mode+0x37/0x1b0
[167013.312789]  ? do_syscall_64+0x93/0x1b0
[167013.312839]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.312896]  ? syscall_exit_to_user_mode+0x37/0x1b0
[167013.312949]  ? do_syscall_64+0x93/0x1b0
[167013.312998]  ? hrtimer_try_to_cancel.part.0+0x50/0xe0
[167013.313054]  ? hrtimer_cancel+0x21/0x40
[167013.313105]  ? futex_wait+0x89/0x120
[167013.313157]  ? futex_wake+0x8f/0x1b0
[167013.313207]  ? do_futex+0x125/0x190
[167013.313255]  ? __x64_sys_futex+0x127/0x1e0
[167013.313306]  ? arch_exit_to_user_mode_prepare.isra.0+0x75/0xa0
[167013.313363]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.313419]  ? syscall_exit_to_user_mode+0x37/0x1b0
[167013.313472]  ? do_syscall_64+0x93/0x1b0
[167013.313520]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[167013.313577]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
[167013.313632] RIP: 0033:0x7f495281c9ee
[167013.313695] Code: 08 0f 85 f5 4b ff ff 49 89 fb 48 89 f0 48 89 d7 48 89 ce 4c 89 c2 4d 89 ca 4c 8b 44 24 08 4c 8b 4c 24 10 4c 89 5c 24 08 0f 05 <c3> 66 2e 0f 1f 84 00 00 00 00 00 0f 1f 80 00 00 00 00 48 83 ec 08
[167013.313819] RSP: 002b:00007f48a2c445a8 EFLAGS: 00000246 ORIG_RAX: 0000000000000013
[167013.313897] RAX: ffffffffffffffda RBX: 00007f48a2c456c0 RCX: 00007f495281c9ee
[167013.313972] RDX: 0000000000000001 RSI: 00007f491806a290 RDI: 000000000000005f
[167013.314046] RBP: 00007f48a2c44630 R08: 0000000000000000 R09: 0000000000000000
[167013.314120] R10: 0000000000000000 R11: 0000000000000246 R12: 00007f491806a290
[167013.314194] R13: 0000000000000001 R14: 00007f48a2c44670 R15: 00007f48c05ee900
[167013.314270]  </TASK>
[167013.314312] Modules linked in: sunrpc binfmt_misc bridge stp llc intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp zfs(POE) coretemp kvm_intel iTCO_wdt intel_pmc_bxt iTCO_vendor_support watchdog kvm mei_hdcp mei_pxp at24 snd_hda_codec_realtek snd_hda_codec_generic snd_hda_scodec_component snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec drm_buddy drm_display_helper snd_hda_core irqbypass snd_hwdep igb cec e1000e rapl snd_pcm intel_cstate rc_core nls_ascii intel_uncore nls_cp437 vfat fat vga16fb ttm snd_timer lpc_ich spl(OE) mxm_wmi i2c_i801 mei_me pcspkr vgastate mei dca i2c_smbus drm_kms_helper snd soundcore intel_smartconnect i2c_algo_bit button joydev evdev sg tcp_bbr drm efi_pstore configfs nfnetlink ip_tables x_tables sd_mod hid_generic usbhid hid ahci libahci libata ehci_pci xhci_pci ehci_hcd crct10dif_pclmul xhci_hcd crc32_pclmul ghash_clmulni_intel usbcore cryptd sha512_ssse3 sha256_ssse3 scsi_mod sha1_ssse3 scsi_common usb_common video wmi btrfs blake2b_generic libcrc32c
[167013.314432]  crc32c_generic crc32c_intel xor raid6_pq loop msr autofs4
[167013.315021] ---[ end trace 0000000000000000 ]---
[167013.315072] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[167013.315127] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[167013.315251] RSP: 0018:ffffcacc2bb8b900 EFLAGS: 00010286
[167013.315303] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 000000000000002e
[167013.315377] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[167013.315451] RBP: ffffcacc2bb8b938 R08: 00000016ce09d000 R09: 00000016ce09d000
[167013.315525] R10: fffffffffffffffe R11: 0000000000007000 R12: ffff890c4e1e6900
[167013.315599] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[167013.315673] FS:  00007f48a2c456c0(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[167013.315750] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[167013.315803] CR2: 000000063f28981c CR3: 000000012b56c003 CR4: 00000000000726f0
[172382.743717] Oops: general protection fault, probably for non-canonical address 0xd3be4ae4168da05c: 0000 [#4] PREEMPT SMP PTI
[172382.743787] CPU: 0 UID: 0 PID: 150812 Comm: zpool Tainted: P      D    OE      6.12.94+deb13-amd64 #1  Debian 6.12.94-1
[172382.743851] Tainted: [P]=PROPRIETARY_MODULE, [D]=DIE, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[172382.743906] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z87 Extreme6, BIOS P2.20 11/25/2013
[172382.743965] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[172382.744005] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[172382.744095] RSP: 0018:ffffcacc027135f0 EFLAGS: 00010286
[172382.744134] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 0000000000000000
[172382.744188] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[172382.744242] RBP: ffffcacc02713630 R08: 000000003fffffff R09: 000000003aba8718
[172382.744296] R10: ffff8911f52d9c30 R11: 00000000ffffffff R12: ffff890c4e1e6900
[172382.744349] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[172382.744403] FS:  00007f512a1ec880(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[172382.744459] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[172382.744497] CR2: 0000562416953000 CR3: 00000006480e2002 CR4: 00000000000726f0
[172382.744551] Call Trace:
[172382.744583]  <TASK>
[172382.744616]  ? aggsum_add+0x16d/0x180 [zfs]
[172382.744829]  spl_kmem_cache_alloc+0x8b/0x600 [spl]
[172382.744875]  ? spl_kmem_cache_alloc+0x10d/0x600 [spl]
[172382.744917]  ? mutex_lock+0x12/0x30
[172382.744953]  abd_alloc_struct_impl+0x1b/0x40 [zfs]
[172382.745138]  abd_alloc_linear+0x1a/0xf0 [zfs]
[172382.745316]  arc_hdr_alloc_abd+0x136/0x190 [zfs]
[172382.745984]  arc_read+0xb09/0x1760 [zfs]
[172382.746161]  ? __pfx_dbuf_read_done+0x10/0x10 [zfs]
[172382.746346]  dbuf_read_impl.constprop.0+0x44d/0x790 [zfs]
[172382.746534]  dbuf_read+0x5d3/0x6b0 [zfs]
[172382.746719]  ? dbuf_hold+0x31/0x60 [zfs]
[172382.746902]  dmu_buf_hold_by_dnode+0x4d/0x80 [zfs]
[172382.747094]  zap_lockdir+0x9e/0x110 [zfs]
[172382.747286]  zap_contains+0x48/0x120 [zfs]
[172382.747478]  vdev_rebuild_get_stats+0x79/0x240 [zfs]
[172382.747677]  top_vdev_actions_getprogress+0x58/0x80 [zfs]
[172382.747877]  vdev_config_generate+0x587/0x8e0 [zfs]
[172382.748075]  vdev_config_generate+0x4fa/0x8e0 [zfs]
[172382.748272]  spa_config_generate+0x262/0x4e0 [zfs]
[172382.748483]  spa_open_common+0x195/0x3e0 [zfs]
[172382.748694]  spa_get_stats+0x5c/0x500 [zfs]
[172382.748904]  ? __kmalloc_node_noprof+0x1bf/0x410
[172382.748940]  ? spl_kmem_alloc+0x11f/0x130 [spl]
[172382.748984]  zfs_ioc_pool_stats+0x3e/0x90 [zfs]
[172382.749173]  zfsdev_ioctl_common+0x892/0x960 [zfs]
[172382.749366]  zfsdev_ioctl+0x53/0xe0 [zfs]
[172382.749541]  __x64_sys_ioctl+0x97/0xc0
[172382.749578]  do_syscall_64+0x87/0x1b0
[172382.749614]  ? __count_memcg_events+0x53/0xf0
[172382.749651]  ? count_memcg_events.constprop.0+0x1a/0x30
[172382.749691]  ? handle_mm_fault+0x1bb/0x2c0
[172382.749727]  ? do_user_addr_fault+0x36c/0x620
[172382.749764]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[172382.749806]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
[172382.749845] RIP: 0033:0x7f512ac0091b
[172382.749890] Code: 00 48 89 44 24 18 31 c0 48 8d 44 24 60 c7 04 24 10 00 00 00 48 89 44 24 08 48 8d 44 24 20 48 89 44 24 10 b8 10 00 00 00 0f 05 <89> c2 3d 00 f0 ff ff 77 1c 48 8b 44 24 18 64 48 2b 04 25 28 00 00
[172382.749979] RSP: 002b:00007ffebd601d60 EFLAGS: 00000246 ORIG_RAX: 0000000000000010
[172382.750035] RAX: ffffffffffffffda RBX: 000056241693f660 RCX: 00007f512ac0091b
[172382.750089] RDX: 00007ffebd601de0 RSI: 0000000000005a05 RDI: 0000000000000003
[172382.750143] RBP: 00007ffebd6053d0 R08: 00007f512acd9ac0 R09: 0000000000000001
[172382.750197] R10: 00007f512acd9f70 R11: 0000000000000246 R12: 00007ffebd601de0
[172382.750251] R13: 000056241693f660 R14: 00005624169384e0 R15: 00007ffebd6053f4
[172382.750306]  </TASK>
[172382.750336] Modules linked in: sunrpc binfmt_misc bridge stp llc intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp zfs(POE) coretemp kvm_intel iTCO_wdt intel_pmc_bxt iTCO_vendor_support watchdog kvm mei_hdcp mei_pxp at24 snd_hda_codec_realtek snd_hda_codec_generic snd_hda_scodec_component snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec drm_buddy drm_display_helper snd_hda_core irqbypass snd_hwdep igb cec e1000e rapl snd_pcm intel_cstate rc_core nls_ascii intel_uncore nls_cp437 vfat fat vga16fb ttm snd_timer lpc_ich spl(OE) mxm_wmi i2c_i801 mei_me pcspkr vgastate mei dca i2c_smbus drm_kms_helper snd soundcore intel_smartconnect i2c_algo_bit button joydev evdev sg tcp_bbr drm efi_pstore configfs nfnetlink ip_tables x_tables sd_mod hid_generic usbhid hid ahci libahci libata ehci_pci xhci_pci ehci_hcd crct10dif_pclmul xhci_hcd crc32_pclmul ghash_clmulni_intel usbcore cryptd sha512_ssse3 sha256_ssse3 scsi_mod sha1_ssse3 scsi_common usb_common video wmi btrfs blake2b_generic libcrc32c
[172382.750400]  crc32c_generic crc32c_intel xor raid6_pq loop msr autofs4
[172382.750813] ---[ end trace 0000000000000000 ]---
[172382.750850] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[172382.750888] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[172382.750978] RSP: 0018:ffffcacc2bb8b900 EFLAGS: 00010286
[172382.751016] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 000000000000002e
[172382.751074] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[172382.751128] RBP: ffffcacc2bb8b938 R08: 00000016ce09d000 R09: 00000016ce09d000
[172382.751182] R10: fffffffffffffffe R11: 0000000000007000 R12: ffff890c4e1e6900
[172382.751236] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[172382.751290] FS:  00007f512a1ec880(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[172382.751346] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[172382.751384] CR2: 0000562416953000 CR3: 00000006480e2002 CR4: 00000000000726f0
[186584.658451] Oops: general protection fault, probably for non-canonical address 0xd3be4ae4168da05c: 0000 [#5] PREEMPT SMP PTI
[186584.658533] CPU: 0 UID: 1000 PID: 2434 Comm: smbd[192.168.0. Tainted: P      D    OE      6.12.94+deb13-amd64 #1  Debian 6.12.94-1
[186584.658609] Tainted: [P]=PROPRIETARY_MODULE, [D]=DIE, [O]=OOT_MODULE, [E]=UNSIGNED_MODULE
[186584.658673] Hardware name: To Be Filled By O.E.M. To Be Filled By O.E.M./Z87 Extreme6, BIOS P2.20 11/25/2013
[186584.658741] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[186584.658787] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[186584.658891] RSP: 0018:ffffcacc019e7320 EFLAGS: 00010286
[186584.658936] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 0000000000000000
[186584.658998] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[186584.659060] RBP: ffffcacc019e7360 R08: 000000003fffffff R09: 000000003aba8b78
[186584.659123] R10: ffff890f44641000 R11: 00000000ffffffff R12: ffff890c4e1e6900
[186584.659184] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[186584.659247] FS:  00007ff6268c9b00(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[186584.659312] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[186584.659356] CR2: 00007ff629867f40 CR3: 00000001199a6002 CR4: 00000000000726f0
[186584.659418] Call Trace:
[186584.659455]  <TASK>
[186584.659494]  ? aggsum_add+0x16d/0x180 [zfs]
[186584.659781]  spl_kmem_cache_alloc+0x8b/0x600 [spl]
[186584.659835]  ? spl_kmem_cache_alloc+0x10d/0x600 [spl]
[186584.659886]  ? mutex_lock+0x12/0x30
[186584.659928]  abd_alloc_struct_impl+0x1b/0x40 [zfs]
[186584.660190]  abd_alloc_linear+0x1a/0xf0 [zfs]
[186584.660441]  arc_hdr_alloc_abd+0x136/0x190 [zfs]
[186584.660693]  arc_read+0xb09/0x1760 [zfs]
[186584.660943]  ? __pfx_dbuf_read_done+0x10/0x10 [zfs]
[186584.661204]  dbuf_read_impl.constprop.0+0x44d/0x790 [zfs]
[186584.661468]  dbuf_read+0x5d3/0x6b0 [zfs]
[186584.661728]  ? dbuf_hold+0x31/0x60 [zfs]
[186584.661991]  dmu_buf_hold_by_dnode+0x4d/0x80 [zfs]
[186584.662266]  zap_lockdir+0x9e/0x110 [zfs]
[186584.662538]  zap_lookup+0x57/0x120 [zfs]
[186584.662809]  zfs_dirent_lock+0x582/0x6c0 [zfs]
[186584.663059]  zfs_dirlook+0xb4/0x320 [zfs]
[186584.663306]  ? zfs_zaccess+0x26f/0x450 [zfs]
[186584.663556]  zfs_lookup+0x264/0x410 [zfs]
[186584.663800]  zpl_xattr_get_dir+0xdd/0x1a0 [zfs]
[186584.664043]  ? nvlist_lookup_byte_array+0x41/0xb0 [zfs]
[186584.664269]  ? zpl_xattr_get_sa+0xae/0x160 [zfs]
[186584.664512]  zpl_xattr_get+0xd5/0x1e0 [zfs]
[186584.664754]  zpl_xattr_user_get+0xe2/0x130 [zfs]
[186584.664997]  __vfs_getxattr+0x82/0xb0
[186584.665040]  do_getxattr+0x74/0x170
[186584.665082]  getxattr+0x91/0xd0
[186584.665125]  path_getxattr+0x7c/0xd0
[186584.665167]  do_syscall_64+0x87/0x1b0
[186584.665210]  ? next_uptodate_folio+0x89/0x2a0
[186584.665254]  ? filemap_map_pages+0x553/0x6a0
[186584.665299]  ? do_fault+0x31a/0x550
[186584.665339]  ? __handle_mm_fault+0x7c2/0xf70
[186584.665382]  ? __do_sys_newfstat+0x68/0x70
[186584.665425]  ? __count_memcg_events+0x53/0xf0
[186584.665469]  ? count_memcg_events.constprop.0+0x1a/0x30
[186584.665515]  ? handle_mm_fault+0x1bb/0x2c0
[186584.665557]  ? do_user_addr_fault+0x36c/0x620
[186584.665599]  ? arch_exit_to_user_mode_prepare.isra.0+0x16/0xa0
[186584.665648]  entry_SYSCALL_64_after_hwframe+0x76/0x7e
[186584.665694] RIP: 0033:0x7ff6294164da
[186584.665747] Code: 48 83 ec 08 e8 67 fc ff ff 48 89 05 50 4b 0e 00 48 83 c4 08 c3 66 2e 0f 1f 84 00 00 00 00 00 90 49 89 ca b8 bf 00 00 00 0f 05 <48> 3d 01 f0 ff ff 73 01 c3 48 8b 0d 06 c9 0d 00 f7 d8 64 89 01 48
[186584.665851] RSP: 002b:00007ffe2b38cb28 EFLAGS: 00000202 ORIG_RAX: 00000000000000bf
[186584.665916] RAX: ffffffffffffffda RBX: 00005581e89ace20 RCX: 00007ff6294164da
[186584.665978] RDX: 00007ffe2b38cba0 RSI: 00007ff629a578c4 RDI: 00007ffe2b38cb30
[186584.666041] RBP: 00007ff629a578c4 R08: 0000000000000064 R09: 00000000fffffffe
[186584.666103] R10: 0000000000000100 R11: 0000000000000202 R12: 00007ffe2b38cba0
[186584.666165] R13: 0000000000000100 R14: 000000000000001e R15: 00005581e899be80
[186584.666229]  </TASK>
[186584.666264] Modules linked in: sunrpc binfmt_misc bridge stp llc intel_rapl_msr intel_rapl_common x86_pkg_temp_thermal intel_powerclamp zfs(POE) coretemp kvm_intel iTCO_wdt intel_pmc_bxt iTCO_vendor_support watchdog kvm mei_hdcp mei_pxp at24 snd_hda_codec_realtek snd_hda_codec_generic snd_hda_scodec_component snd_hda_intel snd_intel_dspcfg snd_intel_sdw_acpi snd_hda_codec drm_buddy drm_display_helper snd_hda_core irqbypass snd_hwdep igb cec e1000e rapl snd_pcm intel_cstate rc_core nls_ascii intel_uncore nls_cp437 vfat fat vga16fb ttm snd_timer lpc_ich spl(OE) mxm_wmi i2c_i801 mei_me pcspkr vgastate mei dca i2c_smbus drm_kms_helper snd soundcore intel_smartconnect i2c_algo_bit button joydev evdev sg tcp_bbr drm efi_pstore configfs nfnetlink ip_tables x_tables sd_mod hid_generic usbhid hid ahci libahci libata ehci_pci xhci_pci ehci_hcd crct10dif_pclmul xhci_hcd crc32_pclmul ghash_clmulni_intel usbcore cryptd sha512_ssse3 sha256_ssse3 scsi_mod sha1_ssse3 scsi_common usb_common video wmi btrfs blake2b_generic libcrc32c
[186584.666352]  crc32c_generic crc32c_intel xor raid6_pq loop msr autofs4
[186584.667346] ---[ end trace 0000000000000000 ]---
[186584.667419] RIP: 0010:kmem_cache_alloc_noprof+0x9c/0x2f0
[186584.667492] Code: 92 c5 73 48 8b 50 08 48 83 78 10 00 48 8b 38 0f 84 ec 01 00 00 48 85 ff 0f 84 e3 01 00 00 41 8b 44 24 28 49 8b 34 24 48 01 f8 <48> 8b 18 48 89 c1 49 33 9c 24 b8 00 00 00 48 89 f8 48 0f c9 48 31
[186584.667663] RSP: 0018:ffffcacc2bb8b900 EFLAGS: 00010286
[186584.667734] RAX: d3be4ae4168da05c RBX: 0000000000000004 RCX: 000000000000002e
[186584.667832] RDX: 0000008efa5dc000 RSI: 000061b8c0614770 RDI: d3be4ae4168da02c
[186584.667930] RBP: ffffcacc2bb8b938 R08: 00000016ce09d000 R09: 00000016ce09d000
[186584.668028] R10: fffffffffffffffe R11: 0000000000007000 R12: ffff890c4e1e6900
[186584.668127] R13: 0000000000042c20 R14: ffffffffc0b7915b R15: 0000000000000060
[186584.668225] FS:  00007ff6268c9b00(0000) GS:ffff89133f600000(0000) knlGS:0000000000000000
[186584.668328] CS:  0010 DS: 0000 ES: 0000 CR0: 0000000080050033
[186584.668398] CR2: 00007ff629867f40 CR3: 00000001199a6002 CR4: 00000000000726f0

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type: DefectIncorrect behavior (e.g. crash, hang)

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions