Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.kernel > #1270250

Re: [PATCH RFC] ioctl based CAT interface

From Marcelo Tosatti <mtosatti@redhat.com>
Newsgroups linux.kernel
Subject Re: [PATCH RFC] ioctl based CAT interface
Date 2015-11-16 15:50 +0100
Message-ID <qvtgu-6H-11@gated-at.bofh.it> (permalink)
References <qupHZ-qL-27@gated-at.bofh.it> <qupRF-up-21@gated-at.bofh.it> <ququl-Y1-11@gated-at.bofh.it> <qvnXt-5nn-35@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw

On Mon, Nov 16, 2015 at 10:07:56AM +0100, Peter Zijlstra wrote:
> On Fri, Nov 13, 2015 at 03:33:04PM -0200, Marcelo Tosatti wrote:
> > On Fri, Nov 13, 2015 at 05:51:00PM +0100, Peter Zijlstra wrote:
> > > On Fri, Nov 13, 2015 at 02:39:33PM -0200, Marcelo Tosatti wrote:
> > > > + * 	* one tcrid entry can be in different locations 
> > > > + * 	  in different sockets.
> > > 
> > > NAK on that without cpuset integration.
> > > 
> > > I do not want freely migratable tasks having radically different
> > > performance profiles depending on which CPU they land.
> > 
> > Ok, so, configuration:
> > 
> > 
> > Socket-1				Socket-2
> > 
> > pinned thread-A with			100% L3 free
> > 80% of L3 
> > reserved
> > 
> > 
> > So it is a problem if a thread running on socket-2 is scheduled to 
> > socket-1 because performance is radically different, fine.
> > 
> > Then one way to avoid that is to not allow freely migratable tasks
> > to move to Socket-1. Fine.
> > 
> > Then you want to use cpusets for that.
> > 
> > Can you fill in the blanks what is missing here?
> 
> I'm still not seeing what the problem with CAT-cgroup is.
> 
> /cgroups/cpuset/
>   socket-1/cpus = $socket-1
>            tasks = $thread-A
> 
>   socket-2/cpus = $socket-2
>            tasks = $thread-B
> 
> /cgroups/cat/
>   group-A/bitmap = 0x3F / 0xFF
>   group-A/tasks = $thread-A
> 
>   group-B/bitmap = 0xFF / 0xFF
>   group-B/tasks = $thread-B
> 
> 
> That gets you thread-A on socket-1 with 6/8 of the L3 and thread-B on
> socket-2 with 8/8 of the L3.

- need bitmasks per socket (optionally).
- format kept in kernel is not universal (have to convert every time
L3 cache size changes).
- need to specify type (i-cache or d-cache, differentiation supported on newer processors), 
ok can add more bitmaps.
- position in bitmask represents nothing other than identification of
  reservation and size, so:

		group-A = 0x3F, group-B = 0xFF
  is the same as
		group-A = 0xFC, group-B = 0xFF

- have to locate a free region every time in the bitmasks. 
So userspace has to do:

# lock write access to /cgroups/cat/
create group-C, taking into account bitmasks of 
group-A and group-B.
# unlock write access to /cgroups/cat.

But OK, it works, lets use that.

--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Back to linux.kernel | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

[PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-13 17:50 +0100
  Re: [PATCH RFC] ioctl based CAT interface Peter Zijlstra <peterz@infradead.org> - 2015-11-13 18:00 +0100
    Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-13 18:30 +0100
      Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-13 18:50 +0100
        Re: [PATCH RFC] ioctl based CAT interface Peter Zijlstra <peterz@infradead.org> - 2015-11-16 10:10 +0100
          Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-16 15:50 +0100
            Re: [PATCH RFC] ioctl based CAT interface Thomas Gleixner <tglx@linutronix.de> - 2015-11-16 15:50 +0100
              Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-16 22:30 +0100
            Re: [PATCH RFC] ioctl based CAT interface Peter Zijlstra <peterz@infradead.org> - 2015-11-16 16:10 +0100
              Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-16 22:30 +0100
              Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-16 22:30 +0100
      Re: [PATCH RFC] ioctl based CAT interface Luiz Capitulino <lcapitulino@redhat.com> - 2015-11-13 20:10 +0100
        Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-13 21:30 +0100
        Re: [PATCH RFC] ioctl based CAT interface Peter Zijlstra <peterz@infradead.org> - 2015-11-16 10:10 +0100
    Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-13 18:40 +0100
      Re: [PATCH RFC] ioctl based CAT interface Peter Zijlstra <peterz@infradead.org> - 2015-11-16 10:10 +0100
        Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-16 15:50 +0100
          Re: [PATCH RFC] ioctl based CAT interface Peter Zijlstra <peterz@infradead.org> - 2015-11-16 16:40 +0100
        Re: [PATCH RFC] ioctl based CAT interface Luiz Capitulino <lcapitulino@redhat.com> - 2015-11-16 17:20 +0100
          Re: [PATCH RFC] ioctl based CAT interface Peter Zijlstra <peterz@infradead.org> - 2015-11-16 17:30 +0100
            Re: [PATCH RFC] ioctl based CAT interface Luiz Capitulino <lcapitulino@redhat.com> - 2015-11-16 17:50 +0100
        Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-16 17:40 +0100
          Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-17 02:10 +0100
    Re: [PATCH RFC] ioctl based CAT interface Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-13 19:10 +0100
      Re: [PATCH RFC] ioctl based CAT interface Peter Zijlstra <peterz@infradead.org> - 2015-11-16 10:20 +0100
  Re: [PATCH RFC] ioctl based CAT interface Luiz Capitulino <lcapitulino@redhat.com> - 2015-11-13 20:10 +0100

csiph-web