Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.kernel > #1385683

Re: Major KVM issues with kernel 4.5 on the host

From Borislav Petkov <bp@alien8.de>
Newsgroups linux.kernel
Subject Re: Major KVM issues with kernel 4.5 on the host
Date 2016-04-23 18:10 +0200
Message-ID <rr8i5-5XD-7@gated-at.bofh.it> (permalink)
References (5 earlier) <rqitb-6j1-11@gated-at.bofh.it> <rqm3N-Ju-35@gated-at.bofh.it> <rqofh-2i1-35@gated-at.bofh.it> <rqq7p-3Lk-15@gated-at.bofh.it> <rqt5g-6Er-3@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


On Thu, Apr 21, 2016 at 10:04:33PM +0200, Marc Haber wrote:
> Yes, but there are two symptoms. The VM either suffers file system
> issues (garbage read from files, or an aborted ext4 journal and
> following ro remount) or it stops dead in its tracks.

Stops dead? What does that mean exactly? Box is wedged solid and it
doesn't react to any key presses?

Because if so, this could really be a DRAM going bad and a correctable
error turning into an uncorrectable. How old is the DRAM in that box?
Judging by your CPU, it should be a couple of years...

> The longest trigger time I have seen was three hours, I tripled that
> to nine hours, that probably was not enough.

So enlarge even more I guess.

> The box reports about one correctable error per week, so I probably
> have a faulty DIMM, but since the issue only surfaces in VMs while the
> host system is in perfect working order...

So it could be that correctable error turns into an uncorrectable one at
some point. But then you should be getting an exception...

> And yes, I am pondering to simply replace the box with an Intel CPU.

Your CPU is fine, from what I've seen so far.

> I see "mce: CPU supports 6 MCE banks" once for each reboot, and about
> 30 "Machine check events logged" since January. How do I see which
> events were logged?

Hmm, you have

[   18.149300] MCE: In-kernel MCE decoding enabled.

that's CONFIG_EDAC_DECODE_MCE, so you should have some "Hardware Error"
lines in dmesg, I'd guess, decoding the errors.

> So you basically select the default for new options.

Yap.

> I go the way of Debian packages since it is easier to handle the
> crypto file systems when the machine is booting up.

As long as you're testing the correct bisection kernels...

> And yes, I think about doing a test reinstall on unencrypted disk to
> find out whether encryption plays a role, but I currently need the
> machine to urgently to take it out of serice for half a month, and,
> again, the host system is in perfect working order, it is just VMs
> that barf.

Yeah, I can't reproduce it here and I have a very similar box to yours
which is otherwise idle, more or less.

Another fact which points to potentially DIMM going bad...

> I check the date of the package I am installing and the date stamp of
> the kernels being installed to /boot. I'm reasonably sure I have that
> under control.

Good.

> ... and if testing a "good" kernel means a day.

Yeah, it is annoying. In a perfect world, we all should have two
identical boxes so that we use one as a workstation and the second for
testing when the first one, the workstation barfs. I should bring that
up with my manager next time... :-)

> And whenever 46896c73c1a4 is present, I need to apply Paolo's patch,
> right?

Yap.

Thanks.

-- 
Regards/Gruss,
    Boris.

ECO tip #101: Trim your mails when you reply.

Back to linux.kernel | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

Re: Major KVM issues with kernel 4.5 on the host Marc Haber <mh+linux-kernel@zugschlus.de> - 2016-04-21 10:50 +0200
  Re: Major KVM issues with kernel 4.5 on the host Borislav Petkov <bp@alien8.de> - 2016-04-21 14:40 +0200
    Re: Major KVM issues with kernel 4.5 on the host Marc Haber <mh+linux-kernel@zugschlus.de> - 2016-04-21 17:00 +0200
      Re: Major KVM issues with kernel 4.5 on the host Borislav Petkov <bp@alien8.de> - 2016-04-21 19:00 +0200
        Re: Major KVM issues with kernel 4.5 on the host Marc Haber <mh+linux-kernel@zugschlus.de> - 2016-04-21 22:10 +0200
          Re: Major KVM issues with kernel 4.5 on the host Borislav Petkov <bp@alien8.de> - 2016-04-23 18:10 +0200
            Re: Major KVM issues with kernel 4.5 on the host Marc Haber <mh+linux-kernel@zugschlus.de> - 2016-04-23 20:50 +0200
              Re: Major KVM issues with kernel 4.5 on the host "Dr. David Alan Gilbert" <dave@treblig.org> - 2016-04-23 21:20 +0200
              Re: Major KVM issues with kernel 4.5 on the host Borislav Petkov <bp@alien8.de> - 2016-04-24 02:00 +0200

csiph-web