Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.kernel > #1664366

Re: [PATCH v11 4/6] mm: function to offer a page block on the free list

Show all headers | View raw

On 06/13/2017 04:54 AM, Dave Hansen wrote:
> On 06/12/2017 01:34 PM, Michael S. Tsirkin wrote:
>> On Mon, Jun 12, 2017 at 09:42:36AM -0700, Dave Hansen wrote:
>>> On 06/12/2017 09:28 AM, Michael S. Tsirkin wrote:
>>>>> The hypervisor is going to throw away the contents of these pages,
>>>>> right?
>>>> It should be careful and only throw away contents that was there before
>>>> report_unused_page_block was invoked.  Hypervisor is responsible for not
>>>> corrupting guest memory.  But that's not something an mm patch should
>>>> worry about.
>>> That makes sense.  I'm struggling to imagine how the hypervisor makes
>>> use of this information, though.  Does it make the pages read-only
>>> before this, and then it knows if there has not been a write *and* it
>>> gets notified via this new mechanism that it can throw the page away?
>> Yes, and specifically, this is how it works for migration.  Normally you
>> start by migrating all of memory, then send updates incrementally if
>> pages have been modified.  This mechanism allows skipping some pages in
>> the 1st stage, if they get changed they will be migrated in the 2nd
>> stage.
> OK, so the migration starts and marks everything read-only.  All the
> pages now have read-only valuable data, or read-only worthless data in
> the case that the page is in the free lists.  In order for a page to
> become non-worthless, it has to have a write done to it, which the
> hypervisor obviously knows about.
>
> With this mechanism, the hypervisor knows it can discard pages which
> have not had a write since they were known to have worthless contents.
>
> Correct?
Right. By the way, ready-only is one of the dirty page logging
methods that a hypervisor uses to capture the pages that are
written by the VM.

>
> That also seems like pretty good information to include in the
> changelog.  Otherwise, folks are going to be left wondering what good
> the mechanism is.  It's pretty non-trivial to figure out. :)
If necessary, I think it's better to keep the introduction at high-level:

Examples of using this API by a hypervisor:
To live migrate a VM from one physical machine to another,
the hypervisor usually transfers all the VM's memory content.
An optimization here is to skip the transfer of memory that are not
in use by the VM, because the content of the unused memory is
worthless.
This API is the used to report the unused pages to the hypervisor.
The pages that have been reported to the hypervisor as unused
pages may be used by the VM after the report. The hypervisor
has a good mechanism (i.e. dirty page logging) to capture
the change. Therefore, if the new used pages are written into some
data, the hypervisor will still transfer them to the destination machine.

What do you guys think?

Best,
Wei

Back to linux.kernel | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

[PATCH v11 0/6] Virtio-balloon Enhancement Wei Wang <wei.w.wang@intel.com> - 2017-06-09 12:50 +0200
  [PATCH v11 5/6] mm: export symbol of next_zone and first_online_pgdat Wei Wang <wei.w.wang@intel.com> - 2017-06-09 12:50 +0200
  [PATCH v11 4/6] mm: function to offer a page block on the free list Wei Wang <wei.w.wang@intel.com> - 2017-06-09 12:50 +0200
    Re: [PATCH v11 4/6] mm: function to offer a page block on the free  list Dave Hansen <dave.hansen@intel.com> - 2017-06-12 16:20 +0200
      Re: [PATCH v11 4/6] mm: function to offer a page block on the free  list "Michael S. Tsirkin" <mst@redhat.com> - 2017-06-12 18:30 +0200
        Re: [PATCH v11 4/6] mm: function to offer a page block on the free  list Dave Hansen <dave.hansen@intel.com> - 2017-06-12 18:50 +0200
          Re: [PATCH v11 4/6] mm: function to offer a page block on the free  list "Michael S. Tsirkin" <mst@redhat.com> - 2017-06-12 22:40 +0200
            Re: [PATCH v11 4/6] mm: function to offer a page block on the free  list Dave Hansen <dave.hansen@intel.com> - 2017-06-12 23:00 +0200
              Re: [PATCH v11 4/6] mm: function to offer a page block on the free  list Wei Wang <wei.w.wang@intel.com> - 2017-06-13 05:00 +0200
  [PATCH v11 1/6] virtio-balloon: deflate via a page list Wei Wang <wei.w.wang@intel.com> - 2017-06-09 12:50 +0200
  [PATCH v11 2/6] virtio-balloon: coding format cleanup Wei Wang <wei.w.wang@intel.com> - 2017-06-09 12:50 +0200
  [PATCH v11 6/6] virtio-balloon: VIRTIO_BALLOON_F_CMD_VQ Wei Wang <wei.w.wang@intel.com> - 2017-06-09 12:50 +0200
    Re: [PATCH v11 6/6] virtio-balloon: VIRTIO_BALLOON_F_CMD_VQ Dave Hansen <dave.hansen@intel.com> - 2017-06-12 16:10 +0200
      Re: [PATCH v11 6/6] virtio-balloon: VIRTIO_BALLOON_F_CMD_VQ Wei Wang <wei.w.wang@intel.com> - 2017-06-13 12:20 +0200
  [PATCH v11 3/6] virtio-balloon: VIRTIO_BALLOON_F_PAGE_CHUNKS Wei Wang <wei.w.wang@intel.com> - 2017-06-09 13:00 +0200
    Re: [PATCH v11 3/6] virtio-balloon: VIRTIO_BALLOON_F_PAGE_CHUNKS "Michael S. Tsirkin" <mst@redhat.com> - 2017-06-13 20:00 +0200
      Re: [PATCH v11 3/6] virtio-balloon: VIRTIO_BALLOON_F_PAGE_CHUNKS Dave Hansen <dave.hansen@intel.com> - 2017-06-13 20:00 +0200
        Re: [PATCH v11 3/6] virtio-balloon: VIRTIO_BALLOON_F_PAGE_CHUNKS "Michael S. Tsirkin" <mst@redhat.com> - 2017-06-13 21:00 +0200
      Re: [virtio-dev] Re: [PATCH v11 3/6] virtio-balloon: VIRTIO_BALLOON_F_PAGE_CHUNKS Wei Wang <wei.w.wang@intel.com> - 2017-06-15 10:10 +0200
        Re: [virtio-dev] Re: [PATCH v11 3/6] virtio-balloon:  VIRTIO_BALLOON_F_PAGE_CHUNKS "Michael S. Tsirkin" <mst@redhat.com> - 2017-06-16 05:20 +0200
  RE: [PATCH v11 0/6] Virtio-balloon Enhancement "Wang, Wei W" <wei.w.wang@intel.com> - 2017-06-09 13:20 +0200

csiph-web