[TRACKING] Kworker stuck at near 100% CPU usage with Ubuntu 22.04

I started experiencing this same issue. Weirdly, if I plug in a microphone in to one of the USB ports, the problem goes away. The second I unplug the microphone, the problem returns. Can you tell when I was unplugging and plugging the mic in? :laughing:

Please give this a try. I am not seeing this issue whatsoever with the recommended OEM kernel.

No a or b, just sudo apt-get install linux-oem-22.04 which will give you 5.17.0.1026.24-oem after reboot.

I can’t seem to write a long reply, I get a “403 forbidden error”.
Same error though with kernel 5.17.0.1026-oem: a kworker at nearly 100% CPU utilization.
Also firefox is unhappy: 130% CPU usage for no apparent reason. The Firefox Task Manager shows 130% for the Firefox process itself, not for any particular tab.

Let’s see if we can find out why I am unable to replicate this using the recommended linux-oem-22.04 kernel, fully up to date Ubuntu 22.04

  • Active applications (even if merely running as an indicator, GNOME extensions added, etc. Some software reacts oddly to USB devices being added.

  • All the latest updates have been run?

  • Is this happening with specific items added? USB microphone, storage devices, etc? If 3.5 mm mic jack, indicate this as well?

  • Please replicate this issue, then what is your output for (once run, arrow down, to see all the details):

journalctl --since "5 minutes ago"

I’d like to see those details from each of the affected. Using this time limiter should keep the details short and super relevant to the most recent event.

If I can determine the trigger, I may be able to confirm this is a kernel issue vs a device issue, then take appropriate action.

Easy to replicate, in ubuntu 22.04 updated to latest.

Active applications: even on a fresh reboot without any.

To activate the issue, load the xhci-pci module, which enables USB devices, including the camera.

In the bays, I have two empty and two full, with a USB-c and a USB-A.

$ date && sudo modprobe xhci-pci
Thu 19 Jan 20:07:17 GMT 2023

$ top
top - 20:07:26 up 20:27,  1 user,  load average: 0.58, 0.79, 0.91
Tasks: 450 total,   2 running, 448 sleeping,   0 stopped,   0 zombie
%Cpu(s):  0.8 us, 12.7 sy,  0.0 ni, 85.7 id,  0.0 wa,  0.0 hi,  0.8 si,  0.0 st
MiB Mem :  64098.0 total,  51676.4 free,   9084.1 used,   3337.4 buff/cache
MiB Swap:  67584.0 total,  67584.0 free,      0.0 used.  52402.8 avail Mem 

    PID USER      PR  NI    VIRT    RES    SHR S  %CPU  %MEM     TIME+ COMMAND                                                                       
 152231 root      20   0       0      0      0 R  93.3   0.0   1:36.28 kworker/5:1+pm                                                                
     45 root      20   0       0      0      0 S  13.3   0.0   0:25.83 ksoftirqd/5                                                                   
   1830 root     -51   0       0      0      0 S   6.7   0.0   0:04.15 irq/188-iwlwifi                                                               
 155748 root      20   0       0      0      0 I   6.7   0.0   0:00.36 kworker/u16:21-i915                                                           
 164855 root      20   0       0      0      0 I   6.7   0.0   0:00.07 kworker/0:2-events                                                            
      1 root      20   0  168360  11144   5676 S   0.0   0.0   0:01.92 systemd 
...

Then:

$ journalctl --since "5 minutes ago"

Save it to text, then stopped the mad kworker with:

$ date && sudo modprobe -r xhci-pci
Thu 19 Jan 20:08:29 GMT 2023

The 5 minute journalctl log is too long to paste here and I can’t upload it. Here are the last few minutes:

...
Jan 19 20:04:48 argent rtkit-daemon[3209]: e[0;38;5;245me[0;1;31me[0;38;5;245mSupervising 10 threads of 7 processes of 1 users.e[0m
Jan 19 20:04:48 argent rtkit-daemon[3209]: e[0;38;5;245me[0;1;31me[0;38;5;245mSupervising 10 threads of 7 processes of 1 users.e[0m
Jan 19 20:05:21 argent kernel: perf: interrupt took too long (2508 > 2500), lowering kernel.perf_event_max_sample_rate to 79500
Jan 19 20:06:23 argent sudo[166756]: e[0;1;39me[0;1;31me[0;1;39m  albert : TTY=pts/2 ; PWD=/tmp ; USER=root ; COMMAND=/usr/sbin/modprobe -r xhci-pcie[0m
Jan 19 20:06:23 argent sudo[166756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jan 19 20:06:23 argent sudo[166756]: pam_unix(sudo:session): session closed for user root
Jan 19 20:07:17 argent sudo[167183]: e[0;1;39me[0;1;31me[0;1;39m  albert : TTY=pts/2 ; PWD=/tmp ; USER=root ; COMMAND=/usr/sbin/modprobe xhci-pcie[0m
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:0d.0: xHCI Host Controller
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:0d.0: new USB bus registered, assigned bus number 1
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:0d.0: hcc params 0x20007fc1 hci version 0x120 quirks 0x0000000200009810
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:0d.0: xHCI Host Controller
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:0d.0: new USB bus registered, assigned bus number 2
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:0d.0: Host supports USB 3.1 Enhanced SuperSpeed
Jan 19 20:07:17 argent kernel: usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15
Jan 19 20:07:17 argent kernel: usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 19 20:07:17 argent kernel: usb usb1: Product: xHCI Host Controller
Jan 19 20:07:17 argent kernel: usb usb1: Manufacturer: Linux 5.15.0-56-generic xhci-hcd
Jan 19 20:07:17 argent kernel: usb usb1: SerialNumber: 0000:00:0d.0
Jan 19 20:07:17 argent kernel: hub 1-0:1.0: USB hub found
Jan 19 20:07:17 argent kernel: hub 1-0:1.0: 1 port detected
Jan 19 20:07:17 argent kernel: usb usb2: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15
Jan 19 20:07:17 argent kernel: usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 19 20:07:17 argent kernel: usb usb2: Product: xHCI Host Controller
Jan 19 20:07:17 argent kernel: usb usb2: Manufacturer: Linux 5.15.0-56-generic xhci-hcd
Jan 19 20:07:17 argent kernel: usb usb2: SerialNumber: 0000:00:0d.0
Jan 19 20:07:17 argent kernel: hub 2-0:1.0: USB hub found
Jan 19 20:07:17 argent kernel: hub 2-0:1.0: 4 ports detected
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:14.0: xHCI Host Controller
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:14.0: hcc params 0x20007fc1 hci version 0x120 quirks 0x0000000000009810
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:14.0: xHCI Host Controller
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4
Jan 19 20:07:17 argent kernel: xhci_hcd 0000:00:14.0: Host supports USB 3.1 Enhanced SuperSpeed
Jan 19 20:07:17 argent kernel: usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 5.15
Jan 19 20:07:17 argent kernel: usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 19 20:07:17 argent kernel: usb usb3: Product: xHCI Host Controller
Jan 19 20:07:17 argent kernel: usb usb3: Manufacturer: Linux 5.15.0-56-generic xhci-hcd
Jan 19 20:07:17 argent kernel: usb usb3: SerialNumber: 0000:00:14.0
Jan 19 20:07:17 argent kernel: hub 3-0:1.0: USB hub found
Jan 19 20:07:17 argent kernel: hub 3-0:1.0: 12 ports detected
Jan 19 20:07:17 argent kernel: usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 5.15
Jan 19 20:07:17 argent kernel: usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1
Jan 19 20:07:17 argent kernel: usb usb4: Product: xHCI Host Controller
Jan 19 20:07:17 argent kernel: usb usb4: Manufacturer: Linux 5.15.0-56-generic xhci-hcd
Jan 19 20:07:17 argent kernel: usb usb4: SerialNumber: 0000:00:14.0
Jan 19 20:07:17 argent kernel: hub 4-0:1.0: USB hub found
Jan 19 20:07:17 argent kernel: hub 4-0:1.0: 4 ports detected
Jan 19 20:07:17 argent sudo[167183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Jan 19 20:07:17 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m1-0:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:0d.0/usb1/1-0:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent sudo[167183]: pam_unix(sudo:session): session closed for user root
Jan 19 20:07:17 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m2-0:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:0d.0/usb2/2-0:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m2-0:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:0d.0/usb2/2-0:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m1-0:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:0d.0/usb1/1-0:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185musb2: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:0d.0/usb2 189:128' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185musb1: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:0d.0/usb1 189:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185musb2: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:0d.0/usb2 189:128' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185musb1: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:0d.0/usb1 189:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167198]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m4-0:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb4/4-0:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167198]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m4-0:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb4/4-0:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185musb4: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb4 189:384' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185musb4: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb4 189:384' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-0:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3/3-0:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-0:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3/3-0:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185musb3: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3 189:256' failed with exit code 1.e[0m
Jan 19 20:07:17 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185musb3: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3 189:256' failed with exit code 1.e[0m
Jan 19 20:07:17 argent kernel: e[0;1;31me[0;1;39me[0;1;31musb usb3-port1: over-current conditione[0m
Jan 19 20:07:18 argent kernel: e[0;1;31me[0;1;39me[0;1;31musb usb3-port3: over-current conditione[0m
Jan 19 20:07:18 argent kernel: usb 3-7: new high-speed USB device number 2 using xhci_hcd
Jan 19 20:07:18 argent kernel: usb 3-7: New USB device found, idVendor=0bda, idProduct=5634, bcdDevice= 0.21
Jan 19 20:07:18 argent kernel: usb 3-7: New USB device strings: Mfr=3, Product=1, SerialNumber=2
Jan 19 20:07:18 argent kernel: usb 3-7: Product: Laptop Camera
Jan 19 20:07:18 argent kernel: usb 3-7: Manufacturer: Generic
Jan 19 20:07:18 argent kernel: usb 3-7: SerialNumber: 200901010001
Jan 19 20:07:18 argent kernel: usb 3-7: Found UVC 1.00 device Laptop Camera (0bda:5634)
Jan 19 20:07:18 argent kernel: input: Laptop Camera: Laptop Camera as /devices/pci0000:00/0000:00:14.0/usb3/3-7/3-7:1.0/input/input29
Jan 19 20:07:18 argent kernel: usb 3-9: new full-speed USB device number 3 using xhci_hcd
Jan 19 20:07:18 argent kernel: usb 3-9: New USB device found, idVendor=27c6, idProduct=609c, bcdDevice= 1.00
Jan 19 20:07:18 argent kernel: usb 3-9: New USB device strings: Mfr=1, Product=2, SerialNumber=3
Jan 19 20:07:18 argent kernel: usb 3-9: Product: Goodix USB2.0 MISC
Jan 19 20:07:18 argent kernel: usb 3-9: Manufacturer: Goodix Technology Co., Ltd.
Jan 19 20:07:18 argent kernel: usb 3-9: SerialNumber: UID5333D4C0_XXXX_MOC_B0
Jan 19 20:07:18 argent kernel: usb 3-10: new full-speed USB device number 4 using xhci_hcd
Jan 19 20:07:18 argent kernel: usb 3-10: New USB device found, idVendor=8087, idProduct=0032, bcdDevice= 0.00
Jan 19 20:07:18 argent kernel: usb 3-10: New USB device strings: Mfr=0, Product=0, SerialNumber=0
Jan 19 20:07:18 argent systemd[1]: Starting Load/Save RF Kill Switch Status...
Jan 19 20:07:18 argent mtp-probe[167290]: checking bus 3, device 3: "/sys/devices/pci0000:00/0000:00:14.0/usb3/3-9"
Jan 19 20:07:18 argent mtp-probe[167291]: checking bus 3, device 2: "/sys/devices/pci0000:00/0000:00:14.0/usb3/3-7"
Jan 19 20:07:18 argent mtp-probe[167290]: bus: 3, device: 3 was not an MTP device
Jan 19 20:07:18 argent mtp-probe[167291]: bus: 3, device: 2 was not an MTP device
Jan 19 20:07:18 argent kernel: Bluetooth: hci0: Firmware timestamp 2022.5 buildtype 1 build 38020
Jan 19 20:07:18 argent kernel: Bluetooth: hci0: Found device firmware: intel/ibt-0041-0041.sfi
Jan 19 20:07:18 argent kernel: Bluetooth: hci0: Boot Address: 0x100800
Jan 19 20:07:18 argent kernel: Bluetooth: hci0: Firmware Version: 132-5.22
Jan 19 20:07:18 argent kernel: Bluetooth: hci0: Firmware already loaded
Jan 19 20:07:18 argent systemd-udevd[167308]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-7:1.1: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3/3-7/3-7:1.1 0:0' failed with exit code 1.e[0m
Jan 19 20:07:18 argent systemd-udevd[167308]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-7:1.1: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3/3-7/3-7:1.1 0:0' failed with exit code 1.e[0m
Jan 19 20:07:18 argent systemd-udevd[167310]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-10:1.1: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3/3-10/3-10:1.1 0:0' failed with exit code 1.e[0m
Jan 19 20:07:18 argent systemd[8320]: Reached target Bluetooth.
Jan 19 20:07:18 argent systemd-udevd[167310]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-10:1.1: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3/3-10/3-10:1.1 0:0' failed with exit code 1.e[0m
Jan 19 20:07:18 argent mtp-probe[167324]: checking bus 3, device 3: "/sys/devices/pci0000:00/0000:00:14.0/usb3/3-9"
Jan 19 20:07:18 argent mtp-probe[167324]: bus: 3, device: 3 was not an MTP device
Jan 19 20:07:18 argent systemd[1]: Reached target Bluetooth Support.
Jan 19 20:07:18 argent systemd[1]: Started Load/Save RF Kill Switch Status.
Jan 19 20:07:18 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-9: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3/3-9 189:258' failed with exit code 1.e[0m
Jan 19 20:07:18 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-9: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3/3-9 189:258' failed with exit code 1.e[0m
Jan 19 20:07:18 argent systemd-udevd[167310]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-10:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3/3-10/3-10:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:18 argent systemd-udevd[167310]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-10:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3/3-10/3-10:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:18 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-10: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3/3-10 189:259' failed with exit code 1.e[0m
Jan 19 20:07:18 argent systemd-udevd[167199]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-10: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3/3-10 189:259' failed with exit code 1.e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) config/udev: Adding input device Laptop Camera: Laptop Camera (/dev/input/event6)e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(**) Laptop Camera: Laptop Camera: Applying InputClass "libinput keyboard catchall"e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) Using input driver 'libinput' for 'Laptop Camera: Laptop Camera'e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) systemd-logind: got fd for /dev/input/event6 13:70 fd 67 paused 0e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(**) Laptop Camera: Laptop Camera: always reports core eventse[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(**) Option "Device" "/dev/input/event6"e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) event6  - Laptop Camera: Laptop Camera: is tagged by udev as: Keyboarde[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) event6  - Laptop Camera: Laptop Camera: device is a keyboarde[0m
Jan 19 20:07:19 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-7:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3/3-7/3-7:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) event6  - Laptop Camera: Laptop Camera: device removede[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(**) Option "config_info" "udev:/sys/devices/pci0000:00/0000:00:14.0/usb3/3-7/3-7:1.0/input/input29/event6"e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) XINPUT: Adding extended input device "Laptop Camera: Laptop Camera" (type: KEYBOARD, id 8)e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(**) Option "xkb_model" "pc105"e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(**) Option "xkb_layout" "us"e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(WW) Option "xkb_variant" requires a string valuee[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(WW) Option "xkb_options" requires a string valuee[0m
Jan 19 20:07:19 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-7:1.0: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3/3-7/3-7:1.0 0:0' failed with exit code 1.e[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) event6  - Laptop Camera: Laptop Camera: is tagged by udev as: Keyboarde[0m
Jan 19 20:07:19 argent /usr/libexec/gdm-x-session[9061]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m(II) event6  - Laptop Camera: Laptop Camera: device is a keyboarde[0m
Jan 19 20:07:19 argent mtp-probe[167346]: checking bus 3, device 2: "/sys/devices/pci0000:00/0000:00:14.0/usb3/3-7"
Jan 19 20:07:19 argent mtp-probe[167346]: bus: 3, device: 2 was not an MTP device
Jan 19 20:07:19 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-7: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_cupsd /devices/pci0000:00/0000:00:14.0/usb3/3-7 189:257' failed with exit code 1.e[0m
Jan 19 20:07:19 argent systemd-udevd[167187]: e[0;1;38;5;185me[0;1;39me[0;1;38;5;185m3-7: Process '/usr/lib/snapd/snap-device-helper bind snap_cups_ippeveprinter /devices/pci0000:00/0000:00:14.0/usb3/3-7 189:257' failed with exit code 1.e[0m
Jan 19 20:07:19 argent bluetoothd[2615]: e[0;1;31me[0;1;39me[0;1;31mFailed to set mode: Blocked through rfkill (0x12)e[0m
Jan 19 20:07:19 argent pulseaudio[8512]: e[0;1;39me[0;1;31me[0;1;39mCould not find org.bluez.BatteryProviderManager1.RegisterBatteryProvider(), is bluetoothd started with experimental features enabled (-E flag)?e[0m
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/ldac_hq
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/ldac_sq
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/ldac_mq
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSink/aptx_hd
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/aptx_hd
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSink/aptx
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/aptx
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSink/sbc
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/sbc
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSink/sbc_xq_453
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/sbc_xq_453
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSink/sbc_xq_512
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/sbc_xq_512
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSink/sbc_xq_552
Jan 19 20:07:19 argent bluetoothd[2615]: Endpoint registered: sender=:1.92 path=/MediaEndpoint/A2DPSource/sbc_xq_552
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 31 with keysym 31 (keycode a).
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 32 with keysym 32 (keycode b).
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 33 with keysym 33 (keycode c).
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 34 with keysym 34 (keycode d).
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 35 with keysym 35 (keycode e).
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 36 with keysym 36 (keycode f).
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 37 with keysym 37 (keycode 10).
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 39 with keysym 39 (keycode 12).
Jan 19 20:07:19 argent gnome-shell[10538]: Window manager warning: Overwriting existing binding of keysym 38 with keysym 38 (keycode 11).
Jan 19 20:07:23 argent systemd[1]: systemd-rfkill.service: Deactivated successfully.

I get “403” error when attempting to edit the above post. Wanted to add:

Headphones: the Framework laptop has a 3.5 mm jack, but I don’t have anything plugged ot it. As far as I know it makes no difference.

Gnome extensions: I don’t know that I’ve added any beyond those present in vanila Ubuntu 22.04.

Wayland vs Xorg: bug in both, but I use Xorg because of this other bug with Kazam an Wayland (can’t write video, only audio): Bug #1992360 “Kazam video screen capture generates empty or blac...” : Bugs : kazam package : Ubuntu

To activate the issue, load the xhci-pci module, which enables USB devices, including the camera. Or reboot.

In the bays, I have two empty and two full, with a USB-c and a USB-A.
The USB-A has given me trouble before, with a mouse that works for a while and then stops working, with “overcurrent condition” in the dmesg: USB port stopped working: over current condition - #10 by Cheese
That error with overcurrent happened before this kworker error ever showed up. I.e. prior Ubuntu linux kernels back then didn’t have a kworker at high CPU usage.

Thanks for the clear outline how to reproduce this. I have attempted to reproduce this on two separate Framework laptops (both 11th and 12th gen).

  • You’ve had this happen on 5.17.0.1026-oem and 5.17.0-1018-oem

  • You tried rebooting to the prior kernel 5.15.0-47 and `5.15.0-46, but with the same result.

  • You removed all USB-c expansion cards except for one with an USB-c pass through, to no avail.

  • This began happening starting on the 21st upon rebooting the framework laptop (which had not been rebooted for several weeks).

So if I have all the details correct:

  • Happened starting the night of the 21st after a reboot (it had not been rebooted in several weeks)

  • Multiple kernels have exhibited the same behavior as of the 21st.

  • Framework laptop worked fine before said reboot.

Next steps to take

  • Kernel version appears to be immaterial here, and we’re seeing additional issues that symptomatically feels like your install has gone south. (Firefox behavior, kworker). So bear this in mind as we take the next step.

  • Create and boot to a Live Ubuntu USB. I have not seen this tested in this thread. This is the absolute first stop when rebooting and update are not helping. If it works, you’re able to modprobe xhci-pci without it going nuts (as I experienced on two separate Framework laptops), then we have an indication as to what is wrong; the install went south.

  • If however, the behavior continues when you modprobe and Firefox is also going nuts, then we may be looking at a hardware issue.

Thanks, I will try out booting from a USB stick. Now I have to find a new USB stick and also time to test it …

By the way this is indeed an 11th gen intel i7:

$ cat /proc/cpuinfo | grep "model name"
model name	: 11th Gen Intel(R) Core(TM) i7-1165G7 @ 2.80GHz

Appreciate that. Yes, please do try a live boot and let’s compare from that.

I’ve had this exact issue occur on a few different versions of Fedora.

For me it seems to most reliability occur when I’ve enabled the “Battery Disconnect” function in the BIOS menus.

Since yesterday night, when I opened up the laptop to take photos of the board and ports, that I don’t have this bug any more. I am beyond puzzled (and happy, yet fearing it will come back). The kernel is 5.15.0-58-generic which I had tried a few days ago and it had the bug; yesterday tests were done with 5.15.0-56-generic.

This week I will be plugging various USB and HDMI devices in the course of my work and we’ll see what happens then.

Delighted this has (be it mysteriously) resolved. :slight_smile:

Not resolved. So this morning I plugged the ethernet card, and a USB-A mouse. For a while, all good. But then BAM! The kworker is up again at 86% CPU or higher.

Would a dmesg help? Here are the last many lines. At the end, again, “overcurrent condition” related, most likely to the USB-A mouse, which stopped working.

[70454.996424] wlp170s0: disconnect from AP 58:59:c2:a9:a3:d5 for new auth to 58:59:c2:a9:a3:e5
[70455.058603] wlp170s0: authenticate with 58:59:c2:a9:a3:e5
[70455.064875] wlp170s0: send auth to 58:59:c2:a9:a3:e5 (try 1/3)
[70455.096331] wlp170s0: authenticated
[70455.103735] wlp170s0: associate with 58:59:c2:a9:a3:e5 (try 1/3)
[70455.105861] wlp170s0: RX ReassocResp from 58:59:c2:a9:a3:e5 (capab=0x11 status=0 aid=27)
[70455.124860] wlp170s0: associated
[70455.211890] wlp170s0: Limiting TX power to 20 (20 - 0) dBm as advertised by 58:59:c2:a9:a3:e5
[70625.858406] wlp170s0: disconnect from AP 58:59:c2:a9:a3:e5 for new auth to 58:59:c2:a9:a3:d5
[70625.936308] wlp170s0: authenticate with 58:59:c2:a9:a3:d5
[70625.944164] wlp170s0: send auth to 58:59:c2:a9:a3:d5 (try 1/3)
[70625.991462] wlp170s0: authenticated
[70625.993459] wlp170s0: associate with 58:59:c2:a9:a3:d5 (try 1/3)
[70625.998666] wlp170s0: RX ReassocResp from 58:59:c2:a9:a3:d5 (capab=0x431 status=0 aid=27)
[70626.022256] wlp170s0: associated
[70626.134636] wlp170s0: Limiting TX power to 20 (20 - 0) dBm as advertised by 58:59:c2:a9:a3:d5
[70668.591007] wlp170s0: disconnect from AP 58:59:c2:a9:a3:d5 for new auth to 58:59:c2:a9:a3:e5
[70668.658225] wlp170s0: authenticate with 58:59:c2:a9:a3:e5
[70668.667822] wlp170s0: send auth to 58:59:c2:a9:a3:e5 (try 1/3)
[70668.701555] wlp170s0: authenticated
[70668.706017] wlp170s0: associate with 58:59:c2:a9:a3:e5 (try 1/3)
[70668.708334] wlp170s0: RX ReassocResp from 58:59:c2:a9:a3:e5 (capab=0x11 status=0 aid=18)
[70668.733755] wlp170s0: associated
[70668.733819] wlp170s0: Limiting TX power to 20 (20 - 0) dBm as advertised by 58:59:c2:a9:a3:e5
[71070.325000] kauditd_printk_skb: 9 callbacks suppressed
[71070.325006] audit: type=1107 audit(1674516406.359:12679): pid=2478 uid=103 auid=4294967295 ses=4294967295 subj=unconfined msg='apparmor="DENIED" operation="dbus_signal"  bus="system" path="/org/freedesktop/login1" interface="org.freedesktop.login1.Manager" member="PrepareForSleep" name=":1.20" mask="receive" pid=499409 label="snap.firefox.firefox" peer_pid=2523 peer_label="unconfined"
                exe="/usr/bin/dbus-daemon" sauid=103 hostname=? addr=? terminal=?'
[71070.354988] wlp170s0: deauthenticating from 58:59:c2:a9:a3:e5 by local choice (Reason: 3=DEAUTH_LEAVING)
[71075.007136] PM: suspend entry (deep)
[71078.036041] Filesystems sync: 3.028 seconds
[71078.038495] Freezing user space processes ... (elapsed 0.003 seconds) done.
[71078.042212] OOM killer disabled.
[71078.042213] Freezing remaining freezable tasks ... (elapsed 0.001 seconds) done.
[71078.044135] printk: Suspending console(s) (use no_console_suspend to debug)
[71079.043067] ACPI: EC: interrupt blocked
[71079.125283] ACPI: PM: Preparing to enter system sleep state S3
[71079.143299] ACPI: EC: event blocked
[71079.143300] ACPI: EC: EC stopped
[71079.143301] ACPI: PM: Saving platform NVS memory
[71079.143413] Disabling non-boot CPUs ...
[71079.145436] smpboot: CPU 1 is now offline
[71079.149502] smpboot: CPU 2 is now offline
[71079.155273] smpboot: CPU 3 is now offline
[71079.159635] smpboot: CPU 4 is now offline
[71079.163585] smpboot: CPU 5 is now offline
[71079.167362] smpboot: CPU 6 is now offline
[71079.171390] smpboot: CPU 7 is now offline
[71079.183065] ACPI: PM: Low-level resume complete
[71079.183277] ACPI: EC: EC started
[71079.183277] ACPI: PM: Restoring platform NVS memory
[71079.184862] Enabling non-boot CPUs ...
[71079.184906] x86: Booting SMP configuration:
[71079.184907] smpboot: Booting Node 0 Processor 1 APIC 0x2
[71079.187359] CPU1 is up
[71079.187382] smpboot: Booting Node 0 Processor 2 APIC 0x4
[71079.190012] CPU2 is up
[71079.190032] smpboot: Booting Node 0 Processor 3 APIC 0x6
[71079.192641] CPU3 is up
[71079.192659] smpboot: Booting Node 0 Processor 4 APIC 0x1
[71079.194052] CPU4 is up
[71079.194073] smpboot: Booting Node 0 Processor 5 APIC 0x3
[71079.195212] CPU5 is up
[71079.195231] smpboot: Booting Node 0 Processor 6 APIC 0x5
[71079.196599] CPU6 is up
[71079.196618] smpboot: Booting Node 0 Processor 7 APIC 0x7
[71079.198250] CPU7 is up
[71079.206444] ACPI: PM: Waking up from system sleep state S3
[71079.215084] ACPI: EC: interrupt unblocked
[71079.598281] ACPI: EC: event unblocked
[71079.872765] usb 3-9: reset full-speed USB device number 3 using xhci_hcd
[71080.043363] nvme nvme0: 8/0/0 default/read/poll queues
[71080.140407] ish-hid {33AECD58-B679-4E54-9BD9-A04D34F0C226}: [hid-ish]: enum_devices_done OK, num_hid_devices=1
[71080.148689] usb 3-7: reset high-speed USB device number 2 using xhci_hcd
[71080.332052] mei_hdcp 0000:00:16.0-b638ab7e-94e2-4ea2-a552-d1c54b627f04: bound 0000:00:02.0 (ops i915_hdcp_component_ops [i915])
[71080.332320] OOM killer enabled.
[71080.332323] Restarting tasks ... done.
[71080.338259] thermal thermal_zone5: failed to read out thermal zone (-61)
[71080.378659] PM: suspend exit
[71080.466534] audit: type=1107 audit(1674554776.360:12680): pid=2478 uid=103 auid=4294967295 ses=4294967295 subj=unconfined msg='apparmor="DENIED" operation="dbus_signal"  bus="system" path="/org/freedesktop/login1" interface="org.freedesktop.login1.Manager" member="PrepareForSleep" name=":1.20" mask="receive" pid=499409 label="snap.firefox.firefox" peer_pid=2523 peer_label="unconfined"
                exe="/usr/bin/dbus-daemon" sauid=103 hostname=? addr=? terminal=?'
[71080.467702] usb 2-3: new SuperSpeed USB device number 3 using xhci_hcd
[71080.489257] usb 2-3: New USB device found, idVendor=0bda, idProduct=8156, bcdDevice=31.04
[71080.489264] usb 2-3: New USB device strings: Mfr=1, Product=2, SerialNumber=6
[71080.489267] usb 2-3: Product: USB 10/100/1G/2.5G LAN
[71080.489269] usb 2-3: Manufacturer: Realtek
[71080.489270] usb 2-3: SerialNumber: 4013000001
[71080.529582] usbcore: registered new interface driver cdc_ether
[71080.552607] cdc_ncm 2-3:2.0: MAC-Address: 9c:bf:0d:00:05:1e
[71080.552612] cdc_ncm 2-3:2.0: setting rx_max = 16384
[71080.552646] cdc_ncm 2-3:2.0: setting tx_max = 16384
[71080.563731] audit: type=1400 audit(1674554776.456:12681): apparmor="DENIED" operation="capable" profile="/usr/sbin/cupsd" pid=912274 comm="cupsd" capability=12  capname="net_admin"
[71080.717711] cdc_ncm 2-3:2.0 eth0: register 'cdc_ncm' at usb-0000:00:0d.0-3, CDC NCM, 9c:bf:0d:00:05:1e
[71080.718311] usbcore: registered new interface driver cdc_ncm
[71080.722616] usbcore: registered new interface driver cdc_wdm
[71080.725747] usbcore: registered new interface driver cdc_mbim
[71080.736242] audit: type=1400 audit(1674554776.632:12682): apparmor="DENIED" operation="capable" profile="/usr/sbin/cups-browsed" pid=912276 comm="cups-browsed" capability=23  capname="sys_nice"
[71080.738826] cdc_ncm 2-3:2.0 enx9cbf0d00051e: renamed from eth0
[71082.664344] usb 3-1: new full-speed USB device number 6 using xhci_hcd
[71082.890719] usb 3-1: New USB device found, idVendor=0738, idProduct=1705, bcdDevice= 2.22
[71082.890728] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[71082.890731] usb 3-1: Product: Mad Catz R.A.T.5 Mouse
[71082.890734] usb 3-1: Manufacturer: Mad Catz
[71082.934641] usbcore: registered new interface driver usbhid
[71082.934647] usbhid: USB HID core driver
[71082.944032] input: Mad Catz Mad Catz R.A.T.5 Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.0/0003:0738:1705.0004/input/input27
[71082.944170] saitek 0003:0738:1705.0004: input,hidraw2: USB HID v1.11 Mouse [Mad Catz Mad Catz R.A.T.5 Mouse] on usb-0000:00:14.0-1/input0
[71083.144326] hid-sensor-hub 001F:8087:0AC2.0003: timeout waiting for response from ISHTP device
[71083.836706] IPv6: ADDRCONF(NETDEV_CHANGE): enx9cbf0d00051e: link becomes ready
[71084.455466] wlp170s0: authenticate with d4:20:b0:af:36:f4
[71084.466862] wlp170s0: send auth to d4:20:b0:af:36:f4 (try 1/3)
[71084.497539] wlp170s0: authenticated
[71084.500207] wlp170s0: associate with d4:20:b0:af:36:f4 (try 1/3)
[71084.502065] wlp170s0: RX AssocResp from d4:20:b0:af:36:f4 (capab=0x1011 status=0 aid=69)
[71084.511248] iwlwifi 0000:aa:00.0: Got NSS = 4 - trimming to 2
[71084.517185] wlp170s0: associated
[71084.587682] wlp170s0: Limiting TX power to 30 (30 - 0) dBm as advertised by d4:20:b0:af:36:f4
[71084.797992] IPv6: ADDRCONF(NETDEV_CHANGE): wlp170s0: link becomes ready
[71084.964432] usb 3-1: USB disconnect, device number 6
[71085.364403] usb 3-1: new full-speed USB device number 7 using xhci_hcd
[71085.691492] usb 3-1: New USB device found, idVendor=0738, idProduct=1705, bcdDevice= 2.22
[71085.691501] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[71085.691504] usb 3-1: Product: Mad Catz R.A.T.5 Mouse
[71085.691506] usb 3-1: Manufacturer: Mad Catz
[71085.695228] input: Mad Catz Mad Catz R.A.T.5 Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.0/0003:0738:1705.0005/input/input28
[71085.695454] saitek 0003:0738:1705.0005: input,hidraw2: USB HID v1.11 Mouse [Mad Catz Mad Catz R.A.T.5 Mouse] on usb-0000:00:14.0-1/input0
[71095.064337] usb 3-1: USB disconnect, device number 7
[71095.420322] usb 3-1: new full-speed USB device number 8 using xhci_hcd
[71095.749730] usb 3-1: New USB device found, idVendor=0738, idProduct=1705, bcdDevice= 2.22
[71095.749735] usb 3-1: New USB device strings: Mfr=1, Product=2, SerialNumber=0
[71095.749736] usb 3-1: Product: Mad Catz R.A.T.5 Mouse
[71095.749738] usb 3-1: Manufacturer: Mad Catz
[71095.752857] input: Mad Catz Mad Catz R.A.T.5 Mouse as /devices/pci0000:00/0000:00:14.0/usb3/3-1/3-1:1.0/0003:0738:1705.0006/input/input29
[71095.753145] saitek 0003:0738:1705.0006: input,hidraw2: USB HID v1.11 Mouse [Mad Catz Mad Catz R.A.T.5 Mouse] on usb-0000:00:14.0-1/input0
[71943.317680] wlp170s0: deauthenticating from d4:20:b0:af:36:f4 by local choice (Reason: 3=DEAUTH_LEAVING)
[72396.173531] usb usb3-port1: over-current condition
[72396.173544] usb 3-1: USB disconnect, device number 8
[72396.585560] usb usb3-port3: over-current condition

Any comments on the above, @Matt_Hartley ? The issue ought to be reopened. It is not solved.

Okay, so we have devices attached. I will match the devices attached (this time also adding the Ethernet expansion card to see if I can replicate this and call it a bug).

If I cannot, then we may have a hardware issue with either the expansion card or the board itself.

As I prepare an external USB pendrive to test the booting from it as you suggested: any linux OS you’d prefer? Ubuntu 22.04 LTS would do?

Is a good choice. Also Fedora 37.

Booting from a USB drive gives the same result: after plugging in the ethernet expansion card, the kworker jumps to ~90% CPU usage.

I’ve traced what the kworker is doing with:

# trace-cmd record -e workqueue:workqueue_queue_work
# trace-cmd report > trace.log

And these are the first 100 lines:

cpus=8
       trace-cmd-809966 [003] 69662.878204: workqueue_queue_work: work struct=0xffff988679f49c08 function=flush_to_ldisc workqueue=events_unbound req_cpu=8192 cpu=4294967295
     kworker/4:1-791872 [004] 69662.878226: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878235: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
            sudo-809964 [002] 69662.878241: workqueue_queue_work: work struct=0xffff98860a3f2408 function=flush_to_ldisc workqueue=events_unbound req_cpu=8192 cpu=4294967295
     kworker/4:1-791872 [004] 69662.878290: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878298: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878353: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878361: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878416: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878424: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878478: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878486: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878541: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878549: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878603: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878611: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878666: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878674: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878729: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878737: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878791: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878799: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878854: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878862: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878917: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878925: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878979: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.878987: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879042: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879050: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879105: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879113: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879167: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879175: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879230: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879238: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879293: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879301: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879355: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879363: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879401: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879409: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879463: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879471: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879526: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879534: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879588: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879596: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879651: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879659: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879713: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879721: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879775: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879783: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879838: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879846: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879884: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879891: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879929: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879937: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.879992: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880000: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880055: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880063: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880101: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880108: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880163: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880171: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880226: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880234: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880289: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880297: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880351: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880359: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880414: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880422: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880477: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880485: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880523: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880531: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880585: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880616: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880670: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880678: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880733: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880741: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880795: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880803: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880887: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880895: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880949: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.880957: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.881012: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.881020: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.881075: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.881083: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.881137: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.881145: workqueue_queue_work: work struct=0xffff988aec840218 function=pm_runtime_work workqueue=pm req_cpu=8192 cpu=4
     kworker/4:1-791872 [004] 69662.881183: workqueue_queue_work: work struct=0xffff988c9c9e7dc0 function=hub_event workqueue=usb_hub_wq req_cpu=8192 cpu=4

Only “solution” I know is sudo modprobe -r xhci-pci, but of course then the buiilt-in camera and the ethernet expansion card don’t work.

To confirm:

  • Booted to Live USB only, not booted to the hard drive.

  • Inserted Ethernet expansion card, CPU spike?

This is beginning to feel like a bad expansion card as it cannot replicate it here with a known to be good working card.

Try one more time, expansion card inserted powered off. Then boot to the Live USB, report back.

The same issue as described above, witnessed it by launching top and having kworked using one CPU, solved by removing the module, all the expansion cards, and reboot:

  1. sudo modprobe -r xhci-pci
  2. Remove all the expansion card
  3. sudo modprobe xhci-pci
  4. Put expansion card one by one