Re: virtio ring layout changes for optimal single-stream performance

From	Cornelia Huck <cornelia.huck@de.ibm.com>
Newsgroups	linux.kernel
Subject	Re: virtio ring layout changes for optimal single-stream performance
Date	2016-01-21 16:40 +0100
Message-ID	<qTpv5-7aA-21@gated-at.bofh.it> (permalink)
References	<qTnCW-5S1-11@gated-at.bofh.it>
Organization	IBM Deutschland Research & Development GmbH Vorsitzende des Aufsichtsrats: Martina Koederitz Geschäftsführung: Dirk Wittkopp Sitz der Gesellschaft: Böblingen Registergericht: Amtsgericht Stuttgart, HRB 243294

Show all headers | View raw

On Thu, 21 Jan 2016 15:39:26 +0200
"Michael S. Tsirkin" <mst@redhat.com> wrote:

> Hi all!
> I have been experimenting with alternative virtio ring layouts,
> in order to speed up single stream performance.
> 
> I have just posted a benchmark I wrote for the purpose, and a (partial)
> alternative layout implementation.  This achieves 20-40% reduction in
> virtio overhead in the (default) polling mode.
> 
> http://article.gmane.org/gmane.linux.kernel.virtualization/26889
> 
> The layout is trying to be as simple as possible, to reduce
> the number of cache lines bouncing between CPUs.

Some kind of diagram or textual description would really help to review
this.

> 
> For benchmarking, the idea is to emulate virtio in user-space,
> artificially adding overhead for e.g. signalling to match what happens
> in case of a VM.

Hm... is this overhead comparable enough between different platform so
that you can get a halfway realistic scenario? What about things like
endianness conversions?

> 
> I'd be very curious to get feedback on this, in particular, some people
> discussed using vectored operations to format virtio ring - would it
> conflict with this work?
> 
> You are all welcome to post enhancements or more layout alternatives as
> patches.

Let me see if I can find time to experiment a bit.

Thread

virtio ring layout changes for optimal single-stream performance "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-21 14:40 +0100
  Re: virtio ring layout changes for optimal single-stream  performance Cornelia Huck <cornelia.huck@de.ibm.com> - 2016-01-21 16:40 +0100
    Re: virtio ring layout changes for optimal single-stream performance "Michael S. Tsirkin" <mst@redhat.com> - 2016-01-21 20:10 +0100

csiph-web