Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page tracking

From	"Michael S. Tsirkin" <mst@redhat.com>
Newsgroups	linux.kernel
Subject	Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page tracking
Date	2016-01-05 10:50 +0100
Message-ID	<qNwpz-eM-7@gated-at.bofh.it> (permalink)
References	<qFmno-5fC-3@gated-at.bofh.it> <qNqka-4nh-7@gated-at.bofh.it> <qNqka-4nh-5@gated-at.bofh.it>
Organization	linux.* mail to news gateway

Show all headers | View raw

On Mon, Jan 04, 2016 at 07:11:25PM -0800, Alexander Duyck wrote:
> >> The two mechanisms referenced above would likely require coordination with
> >> QEMU and as such are open to discussion.  I haven't attempted to address
> >> them as I am not sure there is a consensus as of yet.  My personal
> >> preference would be to add a vendor-specific configuration block to the
> >> emulated pci-bridge interfaces created by QEMU that would allow us to
> >> essentially extend shpc to support guest live migration with pass-through
> >> devices.
> >
> > shpc?
> 
> That is kind of what I was thinking.  We basically need some mechanism
> to allow for the host to ask the device to quiesce.  It has been
> proposed to possibly even look at something like an ACPI interface
> since I know ACPI is used by QEMU to manage hot-plug in the standard
> case.
> 
> - Alex


Start by using hot-unplug for this!

Really use your patch guest side, and write host side
to allow starting migration with the device, but
defer completing it.

So

1.- host tells guest to start tracking memory writes
2.- guest acks
3.- migration starts
4.- most memory is migrated
5.- host tells guest to eject device
6.- guest acks
7.- stop vm and migrate rest of state


It will already be a win since hot unplug after migration starts and
most memory has been migrated is better than hot unplug before migration
starts.

Then measure downtime and profile. Then we can look at ways
to quiesce device faster which really means step 5 is replaced
with "host tells guest to quiesce device and dirty (or just unmap!)
all memory mapped for write by device".

-- 
MST
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Thread

Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page tracking Alexander Duyck <alexander.duyck@gmail.com> - 2016-01-05 04:20 +0100
  Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-05 10:50 +0100
    Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Dr. David Alan Gilbert" <dgilbert@redhat.com> - 2016-01-05 11:10 +0100
      Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-05 11:40 +0100
        Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Dr. David Alan Gilbert" <dgilbert@redhat.com> - 2016-01-05 11:50 +0100
          Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-05 12:10 +0100
            Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Dr. David Alan Gilbert" <dgilbert@redhat.com> - 2016-01-05 12:10 +0100
              Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-05 12:20 +0100
            Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-05 12:10 +0100
          Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-05 12:10 +0100
            Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Dr. David Alan Gilbert" <dgilbert@redhat.com> - 2016-01-05 13:50 +0100
              Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page  tracking "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-05 14:20 +0100
    Re: [RFC PATCH 0/3] x86: Add support for guest DMA dirty page tracking Alexander Duyck <alexander.duyck@gmail.com> - 2016-01-05 17:20 +0100

csiph-web