Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.kernel > #1539573

Re: Still OOM problems with 4.9er kernels

From Michal Hocko <mhocko@kernel.org>
Newsgroups linux.kernel
Subject Re: Still OOM problems with 4.9er kernels
Date 2016-12-09 18:40 +0100
Message-ID <sMxjj-677-5@gated-at.bofh.it> (permalink)
References (2 earlier) <sMntE-hq-13@gated-at.bofh.it> <sMtIK-3UZ-3@gated-at.bofh.it> <sMvKx-55a-5@gated-at.bofh.it> <sMvUe-5nQ-15@gated-at.bofh.it> <sMwQh-5XW-9@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


On Fri 09-12-16 17:58:14, Gerhard Wiesinger wrote:
> On 09.12.2016 17:09, Michal Hocko wrote:
[...]
> > > [97883.882611] Mem-Info:
> > > [97883.883747] active_anon:2915 inactive_anon:3376 isolated_anon:0
> > >                  active_file:3902 inactive_file:3639 isolated_file:0
> > >                  unevictable:0 dirty:205 writeback:0 unstable:0
> > >                  slab_reclaimable:9856 slab_unreclaimable:9682
> > >                  mapped:3722 shmem:59 pagetables:2080 bounce:0
> > >                  free:748 free_pcp:15 free_cma:0
> > there is still some page cache which doesn't seem to be neither dirty
> > nor under writeback. So it should be theoretically reclaimable but for
> > some reason we cannot seem to reclaim that memory.
> > There is still some anonymous memory and free swap so we could reclaim
> > it as well but it all seems pretty down and the memory pressure is
> > really large
> 
> Yes, it might be large on the update situation, but that should be handled
> by a virtual memory system by the kernel, right?

Well this is what we try and call it memory reclaim. But if we are not
able to reclaim anything then we eventually have to give up and trigger
the OOM killer. Now the information that 4.4 made a difference is
interesting. I do not really see any major differences in the reclaim
between 4.3 and 4.4 kernels. The reason might be somewhere else as well.
E.g. some of the subsystem consumes much more memory than before.

Just curious, what kind of filesystem are you using? Could you try some
additional debugging. Enabling reclaim related tracepoints might tell us
more. The following should tell us more
mount -t tracefs none /trace
echo 1 > /trace/events/vmscan/enable
echo 1 > /trace/events/writeback/writeback_congestion_wait/enable
cat /trace/trace_pipe > trace.log

Collecting /proc/vmstat over time might be helpful as well
mkdir logs
while true
do
	cp /proc/vmstat vmstat.$(date +%s)
	sleep 1s
done
-- 
Michal Hocko
SUSE Labs

Back to linux.kernel | Previous | NextPrevious in thread | Next in thread | Find similar | Unroll thread


Thread

Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-11-30 08:20 +0100
  Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-11-30 08:30 +0100
    Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-12-09 08:10 +0100
      Re: Still OOM problems with 4.9er kernels Michal Hocko <mhocko@kernel.org> - 2016-12-09 14:50 +0100
        Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-12-09 17:00 +0100
          Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-12-09 17:10 +0100
          Re: Still OOM problems with 4.9er kernels Michal Hocko <mhocko@kernel.org> - 2016-12-09 17:10 +0100
            Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-12-09 18:10 +0100
              Re: Still OOM problems with 4.9er kernels Michal Hocko <mhocko@kernel.org> - 2016-12-09 18:40 +0100
                Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-12-09 19:10 +0100
                Re: Still OOM problems with 4.9er kernels Vlastimil Babka <vbabka@suse.cz> - 2016-12-09 22:50 +0100
                Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-12-10 15:00 +0100
                Re: Still OOM problems with 4.9er kernels Michal Hocko <mhocko@kernel.org> - 2016-12-12 09:30 +0100
          Re: Still OOM problems with 4.9er kernels Minchan Kim <minchan@kernel.org> - 2016-12-23 04:00 +0100
            Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2017-01-01 18:30 +0100
        Re: Still OOM problems with 4.9er kernels Gerhard Wiesinger <lists@wiesinger.com> - 2016-12-09 17:10 +0100

csiph-web