Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.kernel > #1272517

RE: [RFD] CAT user space interface revisited

Show all headers | View raw

+Tony

> -----Original Message-----
> From: Luiz Capitulino [mailto:lcapitulino@redhat.com]
> Sent: Wednesday, November 18, 2015 11:38 AM
> To: Thomas Gleixner
> Cc: LKML; Peter Zijlstra; x86@kernel.org; Marcelo Tosatti; Shivappa, Vikas; Tejun
> Heo; Yu, Fenghua; Auld, Will; Dugger, Donald D; riel@redhat.com
> Subject: Re: [RFD] CAT user space interface revisited
> 
> On Wed, 18 Nov 2015 19:25:03 +0100 (CET) Thomas Gleixner
> <tglx@linutronix.de> wrote:
> 
> > We really need to make this as configurable as possible from userspace
> > without imposing random restrictions to it. I played around with it on
> > my new intel toy and the restriction to 16 COS ids (that's 8 with CDP
> > enabled) makes it really useless if we force the ids to have the same
> > meaning on all sockets and restrict it to per task partitioning.
> >
> > Even if next generation systems will have more COS ids available,
> > there are not going to be enough to have a system wide consistent view
> > unless we have COS ids > nr_cpus.
> >
> > Aside of that I don't think that a system wide consistent view is
> > useful at all.
> 
> This is a great writeup! I agree with everything you said.
> 
> > So now to the interface part. Unfortunately we need to expose this
> > very close to the hardware implementation as there are really no
> > abstractions which allow us to express the various bitmap
> > combinations. Any abstraction I tried to come up with renders that
> > thing completely useless.
> >
> > I was not able to identify any existing infrastructure where this
> > really fits in. I chose a directory/file based representation. We
> > certainly could do the same with a syscall, but that's just an
> > implementation detail.
> >
> > At top level:
> >
> >    xxxxxxx/cat/max_cosids		<- Assume that all CPUs are the same
> >    xxxxxxx/cat/max_maskbits		<- Assume that all CPUs are the same
> >    xxxxxxx/cat/cdp_enable		<- Depends on CDP availability
> >
> > Per socket data:
> >
> >    xxxxxxx/cat/socket-0/
> >    ...
> >    xxxxxxx/cat/socket-N/l3_size
> >    xxxxxxx/cat/socket-N/hwsharedbits
> >
> > Per socket mask data:
> >
> >    xxxxxxx/cat/socket-N/cos-id-0/
> >    ...
> >    xxxxxxx/cat/socket-N/cos-id-N/inuse
> > 				/cat_mask
> > 				/cdp_mask	<- Data mask if CDP enabled
> >
> > Per cpu default cos id for the cpus on that socket:
> >
> >    xxxxxxx/cat/socket-N/cpu-x/default_cosid
> >    ...
> >    xxxxxxx/cat/socket-N/cpu-N/default_cosid
> >
> > The above allows a simple cpu based partitioning. All tasks which do
> > not have a cache partition assigned on a particular socket use the
> > default one of the cpu they are running on.
> >
> > Now for the task(s) partitioning:
> >
> >    xxxxxxx/cat/partitions/
> >
> > Under that directory one can create partitions
> >
> >    xxxxxxx/cat/partitions/p1/tasks
> > 			    /socket-0/cosid
> > 			    ...
> > 			    /socket-n/cosid
> >
> >    The default value for the per socket cosid is COSID_DEFAULT, which
> >    causes the task(s) to use the per cpu default id.
> 
> I hope I've got all the details right, but this proposal looks awesome.
> There's more people who seem to agree with something like this.
> 
> Btw, I think it should be possible to implement this with cgroups. But I too don't
> care that much on cgroups vs. syscalls.
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

Back to linux.kernel | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

[RFD] CAT user space interface revisited Thomas Gleixner <tglx@linutronix.de> - 2015-11-18 19:30 +0100
  Re: [RFD] CAT user space interface revisited Luiz Capitulino <lcapitulino@redhat.com> - 2015-11-18 20:40 +0100
    RE: [RFD] CAT user space interface revisited "Auld, Will" <will.auld@intel.com> - 2015-11-18 21:00 +0100
  Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-18 23:40 +0100
    Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-19 01:40 +0100
      Re: [RFD] CAT user space interface revisited Thomas Gleixner <tglx@linutronix.de> - 2015-11-19 09:40 +0100
        Re: [RFD] CAT user space interface revisited Luiz Capitulino <lcapitulino@redhat.com> - 2015-11-19 14:50 +0100
        Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-20 17:40 +0100
    Re: [RFD] CAT user space interface revisited Thomas Gleixner <tglx@linutronix.de> - 2015-11-19 09:20 +0100
  Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-19 01:20 +0100
    Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-19 02:10 +0100
      Re: [RFD] CAT user space interface revisited Thomas Gleixner <tglx@linutronix.de> - 2015-11-19 10:10 +0100
        Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-19 23:30 +0100
          Re: [RFD] CAT user space interface revisited Thomas Gleixner <tglx@linutronix.de> - 2015-11-20 09:00 +0100
            Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-20 20:30 +0100
      Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-19 21:40 +0100
    Re: [RFD] CAT user space interface revisited Thomas Gleixner <tglx@linutronix.de> - 2015-11-19 10:10 +0100
    Re: [RFD] CAT user space interface revisited Chao Peng <chao.p.peng@linux.intel.com> - 2015-11-24 09:40 +0100
      Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-25 23:10 +0100
  Re: [RFD] CAT user space interface revisited Chao Peng <chao.p.peng@linux.intel.com> - 2015-11-24 08:40 +0100
    Re: [RFD] CAT user space interface revisited Marcelo Tosatti <mtosatti@redhat.com> - 2015-11-25 23:10 +0100

csiph-web