Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.kernel > #1354167

Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration optimization

From Roman Kagan <rkagan@virtuozzo.com>
Newsgroups linux.kernel
Subject Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration optimization
Date 2016-03-09 15:30 +0100
Message-ID <raNhE-DP-3@gated-at.bofh.it> (permalink)
References (5 earlier) <r8Zdf-89n-3@gated-at.bofh.it> <r909j-mc-9@gated-at.bofh.it> <r9qwO-2v2-7@gated-at.bofh.it> <r9Xj4-7Of-5@gated-at.bofh.it> <ra1PH-2jh-5@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


On Mon, Mar 07, 2016 at 01:40:06PM +0200, Michael S. Tsirkin wrote:
> On Mon, Mar 07, 2016 at 06:49:19AM +0000, Li, Liang Z wrote:
> > > > No. And it's exactly what I mean. The ballooned memory is still
> > > > processed during live migration without skipping. The live migration code is
> > > in migration/ram.c.
> > > 
> > > So if guest acknowledged VIRTIO_BALLOON_F_MUST_TELL_HOST, we can
> > > teach qemu to skip these pages.
> > > Want to write a patch to do this?
> > > 
> > 
> > Yes, we really can teach qemu to skip these pages and it's not hard.  
> > The problem is the poor performance, this PV solution
> 
> Balloon is always PV. And do not call patches solutions please.
> 
> > is aimed to make it more
> > efficient and reduce the performance impact on guest.
> 
> We need to get a bit beyond this.  You are making multiple
> changes, it seems to make sense to split it all up, and analyse each
> change separately.

Couldn't agree more.

There are three stages in this optimization:

1) choosing which pages to skip

2) communicating them from guest to host

3) skip transferring uninteresting pages to the remote side on migration

For (3) there seems to be a low-hanging fruit to amend
migration/ram.c:iz_zero_range() to consult /proc/self/pagemap.  This
would work for guest RAM that hasn't been touched yet or which has been
ballooned out.

For (1) I've been trying to make a point that skipping clean pages is
much more likely to result in noticable benefit than free pages only.

As for (2), we do seem to have a problem with the existing balloon:
according to your measurements it's very slow; besides, I guess it plays
badly with transparent huge pages (as both the guest and the host work
with one 4k page at a time).  This is a problem for other use cases of
balloon (e.g. as a facility for resource management); tackling that
appears a more natural application for optimization efforts.

Thanks,
Roman.

Back to linux.kernel | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization Roman Kagan <rkagan@virtuozzo.com> - 2016-03-04 11:30 +0100
  RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-04 15:30 +0100
    Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Michael S. Tsirkin" <mst@redhat.com> - 2016-03-04 15:50 +0100
      RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-04 16:50 +0100
        Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Michael S. Tsirkin" <mst@redhat.com> - 2016-03-05 21:00 +0100
          RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-07 08:00 +0100
            Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Michael S. Tsirkin" <mst@redhat.com> - 2016-03-07 12:50 +0100
              RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-07 16:10 +0100
              Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization Roman Kagan <rkagan@virtuozzo.com> - 2016-03-09 15:30 +0100
                RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-09 16:30 +0100
                Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Michael S. Tsirkin" <mst@redhat.com> - 2016-03-09 16:40 +0100
                RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-10 02:50 +0100
                Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Michael S. Tsirkin" <mst@redhat.com> - 2016-03-10 13:30 +0100
                Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Michael S. Tsirkin" <mst@redhat.com> - 2016-03-09 16:50 +0100
                Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization Roman Kagan <rkagan@virtuozzo.com> - 2016-03-09 18:10 +0100
                Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Michael S. Tsirkin" <mst@redhat.com> - 2016-03-09 18:40 +0100
                Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization Roman Kagan <rkagan@virtuozzo.com> - 2016-03-10 11:30 +0100
                Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization Rik van Riel <riel@redhat.com> - 2016-03-09 20:40 +0100
                Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization Roman Kagan <rkagan@virtuozzo.com> - 2016-03-10 10:40 +0100
    Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization Paolo Bonzini <pbonzini@redhat.com> - 2016-03-04 17:30 +0100
      Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Dr. David Alan Gilbert" <dgilbert@redhat.com> - 2016-03-04 20:00 +0100
        RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-07 06:40 +0100
        Re: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization Roman Kagan <rkagan@virtuozzo.com> - 2016-03-09 14:30 +0100
          RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-09 15:20 +0100
      RE: [Qemu-devel] [RFC qemu 0/4] A PV solution for live migration  optimization "Li, Liang Z" <liang.z.li@intel.com> - 2016-03-09 07:20 +0100

csiph-web