Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > linux.kernel > #1370810
| From | Waiman Long <waiman.long@hpe.com> |
|---|---|
| Newsgroups | linux.kernel |
| Subject | Re: [RFC][PATCH 1/3] locking: Replace smp_cond_acquire with smp_cond_load_acquire |
| Date | 2016-04-04 20:30 +0200 |
| Message-ID | <rkhq9-7no-13@gated-at.bofh.it> (permalink) |
| References | <rkbXs-31q-9@gated-at.bofh.it> <rkbXs-31q-25@gated-at.bofh.it> |
| Organization | linux.* mail to news gateway |
On 04/04/2016 08:22 AM, Peter Zijlstra wrote:
> This new form allows using hardware assisted waiting.
>
> Requested-by: Will Deacon<will.deacon@arm.com>
> Suggested-by: Linus Torvalds<torvalds@linux-foundation.org>
> Signed-off-by: Peter Zijlstra (Intel)<peterz@infradead.org>
> ---
> include/linux/compiler.h | 25 +++++++++++++++++++------
> kernel/locking/qspinlock.c | 12 ++++++------
> kernel/sched/core.c | 8 ++++----
> kernel/sched/sched.h | 2 +-
> kernel/smp.c | 2 +-
> 5 files changed, 31 insertions(+), 18 deletions(-)
>
> --- a/include/linux/compiler.h
> +++ b/include/linux/compiler.h
> @@ -305,21 +305,34 @@ static __always_inline void __write_once
> })
>
> /**
> - * smp_cond_acquire() - Spin wait for cond with ACQUIRE ordering
> + * smp_cond_load_acquire() - (Spin) wait for cond with ACQUIRE ordering
> + * @ptr: pointer to the variable to wait on
> * @cond: boolean expression to wait for
> *
> * Equivalent to using smp_load_acquire() on the condition variable but employs
> * the control dependency of the wait to reduce the barrier on many platforms.
> *
> + * Due to C lacking lambda expressions we load the value of *ptr into a
> + * pre-named variable @VAL to be used in @cond.
> + *
> * The control dependency provides a LOAD->STORE order, the additional RMB
> * provides LOAD->LOAD order, together they provide LOAD->{LOAD,STORE} order,
> * aka. ACQUIRE.
> */
> -#define smp_cond_acquire(cond) do { \
> - while (!(cond)) \
> - cpu_relax(); \
> - smp_rmb(); /* ctrl + rmb := acquire */ \
> -} while (0)
> +#ifndef smp_cond_load_acquire
> +#define smp_cond_load_acquire(ptr, cond_expr) ({ \
> + typeof(ptr) __PTR = (ptr); \
> + typeof(*ptr) VAL; \
> + for (;;) { \
> + VAL = READ_ONCE(*__PTR); \
> + if (cond_expr) \
> + break; \
> + cpu_relax(); \
> + } \
> + smp_rmb(); /* ctrl + rmb := acquire */ \
> + VAL; \
> +})
> +#endif
Using a predefined VAR seems a bit awkward as a reader of the code may
not know where VAR comes from. How about passing in a variable to hold
the latest value of (*ptr), e.g.
#ifndef smp_cond_load_acquire
#define smp_cond_load_acquire(ptr, var, cond_expr) do { \
typeof(ptr) __PTR = (ptr); \
for (;;) { \
var = READ_ONCE(*__PTR); \
if (cond_expr) \
break; \
cpu_relax(); \
} \
smp_rmb(); /* ctrl + rmb := acquire */ \
} while (0)
#endif
Cheers,
Longman
Back to linux.kernel | Previous | Next — Previous in thread | Find similar | Unroll thread
[RFC][PATCH 0/3] smp_cond_load_acquire + cmpwait Peter Zijlstra <peterz@infradead.org> - 2016-04-04 14:40 +0200
[RFC][PATCH 1/3] locking: Replace smp_cond_acquire with smp_cond_load_acquire Peter Zijlstra <peterz@infradead.org> - 2016-04-04 14:40 +0200
Re: [RFC][PATCH 1/3] locking: Replace smp_cond_acquire with smp_cond_load_acquire Waiman Long <waiman.long@hpe.com> - 2016-04-04 20:30 +0200
csiph-web