Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > linux.debian.kernel > #70797 > unrolled thread
| Started by | jaroslav@thinline.cz |
|---|---|
| First post | 2021-04-26 10:10 +0200 |
| Last post | 2021-07-25 11:40 +0200 |
| Articles | 5 — 4 participants |
Back to article view | Back to linux.debian.kernel
Bug#987598: linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat jaroslav@thinline.cz - 2021-04-26 10:10 +0200
Bug#987598: linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat Chris Hofstaedtler <zeha@debian.org> - 2021-04-26 20:50 +0200
Bug#987598: linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat jaroslav@thinline.cz - 2021-07-25 11:30 +0200
Bug#987598: linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat Salvatore Bonaccorso <carnil@debian.org> - 2021-07-25 11:40 +0200
Bug#987598: marked as done (linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat) "Debian Bug Tracking System" <owner@bugs.debian.org> - 2021-07-25 11:40 +0200
| From | jaroslav@thinline.cz |
|---|---|
| Date | 2021-04-26 10:10 +0200 |
| Subject | Bug#987598: linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat |
| Message-ID | <C84tA-1Ea-1@gated-at.bofh.it> |
Package: src:linux Version: 5.10.28-1 Severity: normal Hello, after upgrading some of our Qemu/KVM host servers to Debian testing I noticed that their CPU load changed from "user" to "system" (observed via Prometheus and Grafana.) After quick digging I found that the new kernel is no longer counting "guest" time and 9th column in /proc/stat stays 0 at all times. This is a regression from Debian stable. Steps to reproduce: chpst -u :40000:40000:115 \ /usr/bin/kvm -m 8192 -smp 4 -nodefaults \ -device virtio-scsi-pci,id=scsi \ -drive file=/mnt/grub.img,if=none,cache=none,format=raw,discard=on,id=disk-lvm-4 \ -device scsi-hd,drive=disk-lvm-4,bus=scsi.0 chpst program is only used to run the guest under unprivileged user in a group which owns /dev/kvm grub.img is a 8MB disk image with GPT and single biosgrub partition. It is only used as a means to make guest's CPU spin on something, any other way should work as well. Observe CPU load with htop set to show detailed CPU time. CPU usage is no longer shown in cyan color (guest), it is shown in red (system) instead. Steal time accounting when running in a virtual machine seems to work correctly. (I removed PCI information included by reportbug since I don't think this is a hardware-related issue. If needed, I can provide it.) -- Package-specific info: ** Version: Linux version 5.10.0-6-amd64 (debian-kernel@lists.debian.org) (gcc-10 (Debian 10.2.1-6) 10.2.1 20210110, GNU ld (GNU Binutils for Debian) 2.35.2) #1 SMP Debian 5.10.28-1 (2021-04-09) ** Command line: BOOT_IMAGE=/boot/vmlinuz-5.10.0-6-amd64 root=UUID=bc4aa9fd-9c63-445e-aeae-2147798879f4 ro amd_iommu=on intel_iommu=on net.ifnames=0 ** Not tainted ** Kernel log: [ 4.185348] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it> [ 4.191508] PTP clock support registered [ 4.194579] ccp 0000:42:00.1: SEV API:0.24 build:3 [ 4.264204] checking generic (b6000000 300000) vs hw (b6000000 1000000) [ 4.264207] fb0: switching to astdrmfb from EFI VGA [ 4.268024] Console: switching to colour dummy device 80x25 [ 4.268247] ast 0000:c4:00.0: [drm] P2A bridge disabled, using default configuration [ 4.268250] ast 0000:c4:00.0: [drm] AST 2500 detected [ 4.268257] ast 0000:c4:00.0: [drm] Analog VGA only [ 4.268259] ast 0000:c4:00.0: [drm] dram MCLK=800 Mhz type=1 bus_width=16 [ 4.268804] [TTM] Zone kernel: Available graphics memory: 131929092 KiB [ 4.268807] [TTM] Zone dma32: Available graphics memory: 2097152 KiB [ 4.268808] [TTM] Initializing pool allocator [ 4.268812] [TTM] Initializing DMA pool allocator [ 4.269010] [drm] Initialized ast 0.1.0 20120228 for 0000:c4:00.0 on minor 0 [ 4.273003] fbcon: astdrmfb (fb0) is primary device [ 4.284407] Console: switching to colour frame buffer device 128x48 [ 4.286804] ast 0000:c4:00.0: [drm] fb0: astdrmfb frame buffer device [ 4.295928] tg3 0000:c6:00.0 eth0: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address ac:1f:6b:e5:e1:7e [ 4.296009] tg3 0000:c6:00.0 eth0: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 4.296060] tg3 0000:c6:00.0 eth0: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1] [ 4.296102] tg3 0000:c6:00.0 eth0: dma_rwctrl[00000001] dma_mask[64-bit] [ 4.312469] tg3 0000:c6:00.1 eth1: Tigon3 [partno(BCM95720) rev 5720000] (PCI Express) MAC address ac:1f:6b:e5:e1:7f [ 4.312529] tg3 0000:c6:00.1 eth1: attached PHY is 5720C (10/100/1000Base-T Ethernet) (WireSpeed[1], EEE[1]) [ 4.312582] tg3 0000:c6:00.1 eth1: RXcsums[1] LinkChgREG[0] MIirq[0] ASF[1] TSOcap[1] [ 4.312625] tg3 0000:c6:00.1 eth1: dma_rwctrl[00000001] dma_mask[64-bit] [ 4.320397] input: PC Speaker as /devices/platform/pcspkr/input/input3 [ 4.329707] RAPL PMU: API unit is 2^-32 Joules, 1 fixed counters, 163840 ms ovfl timer [ 4.329951] RAPL PMU: hw unit of domain package 2^-16 Joules [ 4.336927] pstore: ignoring unexpected backend 'efi' [ 4.339850] cryptd: max_cpu_qlen set to 1000 [ 4.350152] AVX2 version of gcm_enc/dec engaged. [ 4.350175] AES CTR mode by8 optimization enabled [ 4.543242] kvm: Nested Virtualization enabled [ 4.543417] SVM: kvm: Nested Paging enabled [ 4.543430] SVM: Virtual VMLOAD VMSAVE supported [ 4.543444] SVM: Virtual GIF supported [ 4.548630] MCE: In-kernel MCE decoding enabled. [ 4.551186] EDAC amd64: F17h_M30h detected (node 0). [ 4.560369] EDAC amd64: Node 0: DRAM ECC enabled. [ 4.561135] EDAC amd64: MCT channel count: 8 [ 4.562760] EDAC MC0: Giving out device to module amd64_edac controller F17h_M30h: DEV 0000:00:18.3 (INTERRUPT) [ 4.566733] EDAC MC: UMC0 chip selects: [ 4.566735] EDAC amd64: MC: 0: 16384MB 1: 16384MB [ 4.567578] EDAC amd64: MC: 2: 0MB 3: 0MB [ 4.569941] EDAC MC: UMC1 chip selects: [ 4.569942] EDAC amd64: MC: 0: 16384MB 1: 16384MB [ 4.570596] EDAC amd64: MC: 2: 0MB 3: 0MB [ 4.574730] EDAC MC: UMC2 chip selects: [ 4.574730] EDAC amd64: MC: 0: 16384MB 1: 16384MB [ 4.575524] EDAC amd64: MC: 2: 0MB 3: 0MB [ 4.576192] EDAC MC: UMC3 chip selects: [ 4.576193] EDAC amd64: MC: 0: 16384MB 1: 16384MB [ 4.576827] EDAC amd64: MC: 2: 0MB 3: 0MB [ 4.578239] EDAC MC: UMC4 chip selects: [ 4.578239] EDAC amd64: MC: 0: 16384MB 1: 16384MB [ 4.578800] EDAC amd64: MC: 2: 0MB 3: 0MB [ 4.582730] EDAC MC: UMC5 chip selects: [ 4.582730] EDAC amd64: MC: 0: 16384MB 1: 16384MB [ 4.583439] EDAC amd64: MC: 2: 0MB 3: 0MB [ 4.586536] EDAC MC: UMC6 chip selects: [ 4.586536] EDAC amd64: MC: 0: 16384MB 1: 16384MB [ 4.587094] EDAC amd64: MC: 2: 0MB 3: 0MB [ 4.590729] EDAC MC: UMC7 chip selects: [ 4.590730] EDAC amd64: MC: 0: 16384MB 1: 16384MB [ 4.591410] EDAC amd64: MC: 2: 0MB 3: 0MB [ 4.591964] EDAC amd64: using x16 syndromes. [ 4.592496] EDAC PCI0: Giving out device to module amd64_edac controller EDAC PCI controller: DEV 0000:00:18.0 (POLLED) [ 4.593049] AMD64 EDAC driver v3.5.0 [ 4.658759] ipmi_si dmi-ipmi-si.0: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 4.734200] ipmi_si dmi-ipmi-si.0: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x1b2b, dev_id: 0x20) [ 4.776164] ipmi_si dmi-ipmi-si.0: IPMI kcs interface initialized [ 4.781864] ipmi_ssif: IPMI SSIF Interface driver [ 6.762142] EXT4-fs (md0): re-mounted. Opts: discard,errors=remount-ro [ 7.103635] loop: module loaded [ 7.156394] tun: Universal TUN/TAP device driver, 1.6 [ 7.205055] bridge: filtering via arp/ip/ip6tables is no longer available by default. Update your scripts to load br_netfilter if you need this. [ 7.214580] Bridge firewalling registered [ 7.274324] VFIO - User Level meta-driver version: 0.3 [ 7.590700] br0: port 1(eth0) entered blocking state [ 7.591734] br0: port 1(eth0) entered disabled state [ 7.594832] device eth0 entered promiscuous mode [ 11.342993] tg3 0000:c6:00.0 eth0: Link is up at 1000 Mbps, full duplex [ 11.344061] tg3 0000:c6:00.0 eth0: Flow control is on for TX and on for RX [ 11.345061] tg3 0000:c6:00.0 eth0: EEE is disabled [ 11.346066] IPv6: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready [ 11.347147] br0: port 1(eth0) entered blocking state [ 11.348115] br0: port 1(eth0) entered forwarding state [ 11.357391] IPv6: ADDRCONF(NETDEV_CHANGE): br0: link becomes ready [ 12.677107] br1: port 1(eth1) entered blocking state [ 12.678069] br1: port 1(eth1) entered disabled state [ 12.679060] device eth1 entered promiscuous mode [ 16.220975] tg3 0000:c6:00.1 eth1: Link is up at 1000 Mbps, full duplex [ 16.221879] tg3 0000:c6:00.1 eth1: Flow control is off for TX and off for RX [ 16.222719] tg3 0000:c6:00.1 eth1: EEE is disabled [ 16.223562] IPv6: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready [ 16.224486] br1: port 1(eth1) entered blocking state [ 16.225316] br1: port 1(eth1) entered forwarding state [ 16.234489] IPv6: ADDRCONF(NETDEV_CHANGE): br1: link becomes ready [ 18.474085] sdj: ** Model information sys_vendor: Supermicro product_name: Super Server product_version: 0123456789 chassis_vendor: Supermicro chassis_version: 0123456789 bios_vendor: American Megatrends Inc. bios_version: 1.2 board_vendor: Supermicro board_name: H12SSW-iN board_version: 1.01 ** Loaded modules: nf_conntrack_netlink nft_chain_nat nf_nat nft_reject_inet nf_reject_ipv4 nf_reject_ipv6 nft_reject nf_log_ipv6 nf_log_ipv4 nf_log_common nft_log nft_limit nft_counter nft_ct nls_ascii nls_cp437 vfat fat nf_tables nfnetlink sch_hfsc sch_fq_codel efivarfs vfio_pci vfio_virqfd vfio_iommu_type1 vfio nf_conntrack_ftp br_netfilter bridge stp llc nf_conntrack nf_defrag_ipv6 nf_defrag_ipv4 vhost_net tun vhost vhost_iotlb tap bonding loop ipmi_ssif amd64_edac_mod edac_mce_amd amd_energy kvm_amd kvm irqbypass crc32_pclmul ghash_clmulni_intel aesni_intel libaes crypto_simd cryptd glue_helper rapl efi_pstore pcspkr ast drm_vram_helper drm_ttm_helper ttm drm_kms_helper tg3 cec libphy drm ptp pps_core i2c_algo_bit sp5100_tco ccp watchdog sg rng_core joydev i2c_piix4 k10temp acpi_ipmi ipmi_si button ipmi_devintf ipmi_msghandler acpi_cpufreq ext4 crc16 mbcache jbd2 raid10 raid456 libcrc32c crc32c_generic async_raid6_recov async_memcpy async_pq async_xor xor async_tx evdev hid_generic usbhid hid raid6_pq raid0 multipath linear raid1 md_mod sd_mod t10_pi crc_t10dif crct10dif_generic crct10dif_pclmul crct10dif_common crc32c_intel xhci_pci xhci_hcd ahci libahci libata usbcore scsi_mod usb_common ** PCI devices: 00:00.0 Host bridge [0600]: Advanced Micro Devices, Inc. [AMD] Starship/Matisse Root Complex [1022:1480] Subsystem: Super Micro Computer Inc Starship/Matisse Root Complex [15d9:1b2b] Control: I/O- Mem- BusMaster- SpecCycle- MemWINV- VGASnoop- ParErr- Stepping- SERR- FastB2B- DisINTx- Status: Cap- 66MHz- UDF- FastB2B- ParErr- DEVSEL=fast >TAbort- <TAbort- <MAbort- >SERR- <PERR- INTx- ** USB devices: not available -- System Information: Debian Release: bullseye/sid APT prefers testing APT policy: (500, 'testing') Architecture: amd64 (x86_64) Kernel: Linux 5.10.0-6-amd64 (SMP w/64 CPU threads) Locale: LANG=en_US.UTF-8, LC_CTYPE=en_US.UTF-8 (charmap=UTF-8), LANGUAGE not set Shell: /bin/sh linked to /bin/dash Init: sysvinit (via /sbin/init) Versions of packages linux-image-5.10.0-6-amd64 depends on: ii initramfs-tools [linux-initramfs-tool] 0.140 ii kmod 28-1 ii linux-base 4.6 Versions of packages linux-image-5.10.0-6-amd64 recommends: pn apparmor <none> pn firmware-linux-free <none> Versions of packages linux-image-5.10.0-6-amd64 suggests: pn debian-kernel-handbook <none> ii grub-efi-amd64 2.04-17 pn linux-doc-5.10 <none> Versions of packages linux-image-5.10.0-6-amd64 is related to: pn firmware-amd-graphics <none> pn firmware-atheros <none> pn firmware-bnx2 <none> pn firmware-bnx2x <none> pn firmware-brcm80211 <none> pn firmware-cavium <none> pn firmware-intel-sound <none> pn firmware-intelwimax <none> pn firmware-ipw2x00 <none> pn firmware-ivtv <none> pn firmware-iwlwifi <none> pn firmware-libertas <none> pn firmware-linux-nonfree <none> pn firmware-misc-nonfree <none> pn firmware-myricom <none> pn firmware-netxen <none> pn firmware-qlogic <none> pn firmware-realtek <none> pn firmware-samsung <none> pn firmware-siano <none> pn firmware-ti-connectivity <none> pn xen-hypervisor <none> -- no debconf information
[toc] | [next] | [standalone]
| From | Chris Hofstaedtler <zeha@debian.org> |
|---|---|
| Date | 2021-04-26 20:50 +0200 |
| Message-ID | <C8esV-7nt-5@gated-at.bofh.it> |
| In reply to | #70797 |
* jaroslav@thinline.cz <jaroslav@thinline.cz> [210426 18:43]:
> after upgrading some of our Qemu/KVM host servers to Debian testing I
> noticed that their CPU load changed from "user" to "system" (observed via
> Prometheus and Grafana.) After quick digging I found that the new kernel is
> no longer counting "guest" time and 9th column in /proc/stat stays 0 at all
> times. This is a regression from Debian stable.
Cf. https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=986371 and
https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1922846
Upstream bug: https://bugzilla.kernel.org/show_bug.cgi?id=209831
[toc] | [prev] | [next] | [standalone]
| From | jaroslav@thinline.cz |
|---|---|
| Date | 2021-07-25 11:30 +0200 |
| Message-ID | <CEICl-8gR-1@gated-at.bofh.it> |
| In reply to | #70797 |
Hello, looks like this is fixed in current kernel version in Bullseye. Thanks for your help.
[toc] | [prev] | [next] | [standalone]
| From | Salvatore Bonaccorso <carnil@debian.org> |
|---|---|
| Date | 2021-07-25 11:40 +0200 |
| Message-ID | <CEIM1-8k6-1@gated-at.bofh.it> |
| In reply to | #72457 |
Source: linux Source-Version: 5.10.46-1 Hi, On Sun, Jul 25, 2021 at 11:17:54AM +0200, jaroslav@thinline.cz wrote: > Hello, > > looks like this is fixed in current kernel version in Bullseye. Thanks, looks was fixed around 5.10.41 upstream and so included in 5.10.46-1. Closing accordingly, thanks for reporting back! Regards, Salvatore
[toc] | [prev] | [next] | [standalone]
| From | "Debian Bug Tracking System" <owner@bugs.debian.org> |
|---|---|
| Date | 2021-07-25 11:40 +0200 |
| Subject | Bug#987598: marked as done (linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat) |
| Message-ID | <CEIM1-8k6-11@gated-at.bofh.it> |
| In reply to | #70797 |
[Multipart message — attachments visible in raw view] — view raw
Your message dated Sun, 25 Jul 2021 11:35:12 +0200 with message-id <YP0wUK0geRTpsUhC@eldamar.lan> and subject line Re: Bug#987598: linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat has caused the Debian Bug report #987598, regarding linux-image-5.10.0-6-amd64: no longer accounting guest CPU time in /proc/stat to be marked as done. This means that you claim that the problem has been dealt with. If this is not the case it is now your responsibility to reopen the Bug report if necessary, and/or fix the problem forthwith. (NB: If you are a system administrator and have no idea what this message is talking about, this may indicate a serious mail system misconfiguration somewhere. Please contact owner@bugs.debian.org immediately.) -- 987598: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=987598 Debian Bug Tracking System Contact owner@bugs.debian.org with problems
[toc] | [prev] | [standalone]
Back to top | Article view | linux.debian.kernel
csiph-web