Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.kernel > #1215095 > unrolled thread

Re: CONFIG_HOLES_IN_ZONE and memory hot plug code on x86_64

Started byYinghai Lu <yinghai@kernel.org>
First post2015-08-28 07:30 +0200
Last post2015-08-28 18:00 +0200
Articles 3 — 2 participants

Back to article view | Back to linux.kernel

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.


Contents

  Re: CONFIG_HOLES_IN_ZONE and memory hot plug code on x86_64 Yinghai Lu <yinghai@kernel.org> - 2015-08-28 07:30 +0200
    Re: CONFIG_HOLES_IN_ZONE and memory hot plug code on x86_64 Steffen Persvold <sp@numascale.com> - 2015-08-28 09:20 +0200
      Re: CONFIG_HOLES_IN_ZONE and memory hot plug code on x86_64 Yinghai Lu <yinghai@kernel.org> - 2015-08-28 18:00 +0200

#1215095 — Re: CONFIG_HOLES_IN_ZONE and memory hot plug code on x86_64

FromYinghai Lu <yinghai@kernel.org>
Date2015-08-28 07:30 +0200
SubjectRe: CONFIG_HOLES_IN_ZONE and memory hot plug code on x86_64
Message-ID<q2koF-29v-3@gated-at.bofh.it>
On Fri, Jun 26, 2015 at 4:31 PM, Steffen Persvold <sp@numascale.com> wrote:
> We’ve encountered an issue in a special case where we have a sparse E820 map [1].
>
> Basically the memory hotplug code is causing a “kernel paging request” BUG [2].

the trace does not look like hotplug path.

>
> By instrumenting the function register_mem_sect_under_node() in drivers/base/node.c we see that it is called two times with the same struct memory_block argument :
>
> [    1.901463] register_mem_sect_under_node: start = 80, end = 8f, nid = 0
> [    1.908129] register_mem_sect_under_node: start = 80, end = 8f, nid = 1

Can you post whole log with SRAT related info?

Yinghai
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

[toc] | [next] | [standalone]


#1215184

FromSteffen Persvold <sp@numascale.com>
Date2015-08-28 09:20 +0200
Message-ID<q2m79-4Ey-37@gated-at.bofh.it>
In reply to#1215095
DQoNCg0KDQoNCk9uIDI3LzA4LzE1IDIyOjIwICwgInlobHUua2VybmVsQGdtYWlsLmNvbSBvbiBi
ZWhhbGYgb2YgWWluZ2hhaSBMdSIgPHlobHUua2VybmVsQGdtYWlsLmNvbSBvbiBiZWhhbGYgb2Yg
eWluZ2hhaUBrZXJuZWwub3JnPiB3cm90ZToNCg0KPk9uIEZyaSwgSnVuIDI2LCAyMDE1IGF0IDQ6
MzEgUE0sIFN0ZWZmZW4gUGVyc3ZvbGQgPHNwQG51bWFzY2FsZS5jb20+IHdyb3RlOg0KPj4gV2Xi
gJl2ZSBlbmNvdW50ZXJlZCBhbiBpc3N1ZSBpbiBhIHNwZWNpYWwgY2FzZSB3aGVyZSB3ZSBoYXZl
IGEgc3BhcnNlIEU4MjAgbWFwIFsxXS4NCj4+DQo+PiBCYXNpY2FsbHkgdGhlIG1lbW9yeSBob3Rw
bHVnIGNvZGUgaXMgY2F1c2luZyBhIOKAnGtlcm5lbCBwYWdpbmcgcmVxdWVzdOKAnSBCVUcgWzJd
Lg0KPg0KPnRoZSB0cmFjZSBkb2VzIG5vdCBsb29rIGxpa2UgaG90cGx1ZyBwYXRoLg0KPg0KPj4N
Cj4+IEJ5IGluc3RydW1lbnRpbmcgdGhlIGZ1bmN0aW9uIHJlZ2lzdGVyX21lbV9zZWN0X3VuZGVy
X25vZGUoKSBpbiBkcml2ZXJzL2Jhc2Uvbm9kZS5jIHdlIHNlZSB0aGF0IGl0IGlzIGNhbGxlZCB0
d28gdGltZXMgd2l0aCB0aGUgc2FtZSBzdHJ1Y3QgbWVtb3J5X2Jsb2NrIGFyZ3VtZW50IDoNCj4+
DQo+PiBbICAgIDEuOTAxNDYzXSByZWdpc3Rlcl9tZW1fc2VjdF91bmRlcl9ub2RlOiBzdGFydCA9
IDgwLCBlbmQgPSA4ZiwgbmlkID0gMA0KPj4gWyAgICAxLjkwODEyOV0gcmVnaXN0ZXJfbWVtX3Nl
Y3RfdW5kZXJfbm9kZTogc3RhcnQgPSA4MCwgZW5kID0gOGYsIG5pZCA9IDENCj4NCj5DYW4geW91
IHBvc3Qgd2hvbGUgbG9nIHdpdGggU1JBVCByZWxhdGVkIGluZm8/DQoNCkkgY2FuIHByb2JhYmx5
IHJlcHJvZHVjZSBhZ2FpbiBhbmQgZ2V0IGZ1bGwgbG9ncyB3aGVuIEkgZ2V0IHJ1biB0aW1lIG9u
IHRoZSBzeXN0ZW0gYWdhaW4sIGJ1dCBoZXJl4oCZcyBzb21lIG91dHB1dCB0aGF0IHdlIHNhdmVk
IGluIG91ciBpbnRlcm5hbCBKaXJhIGNhc2UgOg0KDQpbICAgIDAuMDAwMDAwXSBOVU1BOiBJbml0
aWFsaXplZCBkaXN0YW5jZSB0YWJsZSwgY250PTYNClsgICAgMC4wMDAwMDBdIE5VTUE6IE5vZGUg
MCBbbWVtIDB4MDAwMDAwMDAtMHgwMDA5ZmZmZl0gKyBbbWVtIDB4MDAxMDAwMDAtMHhkN2ZmZmZm
Zl0gLT4gW21lbSAweDAwMDAwMDAwLTB4ZDdmZmZmZmZdDQpbICAgIDAuMDAwMDAwXSBOVU1BOiBO
b2RlIDAgW21lbSAweDAwMDAwMDAwLTB4ZDdmZmZmZmZdICsgW21lbSAweDEwMDAwMDAwMC0weDQy
N2ZmZmZmZl0gLT4gW21lbSAweDAwMDAwMDAwLTB4NDI3ZmZmZmZmXQ0KWyAgICAwLjAwMDAwMF0g
Tk9ERV9EQVRBKDApIGFsbG9jYXRlZCBbbWVtIDB4NDA3ZmUzMDAwLTB4NDA3ZmZmZmZmXQ0KWyAg
ICAwLjAwMDAwMF0gTk9ERV9EQVRBKDEpIGFsbG9jYXRlZCBbbWVtIDB4ODA3ZmUzMDAwLTB4ODA3
ZmZmZmZmXQ0KWyAgICAwLjAwMDAwMF0gTk9ERV9EQVRBKDIpIGFsbG9jYXRlZCBbbWVtIDB4YzA3
ZmUzMDAwLTB4YzA3ZmZmZmZmXQ0KWyAgICAwLjAwMDAwMF0gTk9ERV9EQVRBKDMpIGFsbG9jYXRl
ZCBbbWVtIDB4MTAwN2ZlMzAwMC0weDEwMDdmZmZmZmZdDQpbICAgIDAuMDAwMDAwXSBOT0RFX0RB
VEEoNCkgYWxsb2NhdGVkIFttZW0gMHgxNDA3ZmUzMDAwLTB4MTQwN2ZmZmZmZl0NClsgICAgMC4w
MDAwMDBdIE5PREVfREFUQSg1KSBhbGxvY2F0ZWQgW21lbSAweDE4MDdmZGQwMDAtMHgxODA3ZmY5
ZmZmXQ0KWyAgICAwLjAwMDAwMF0gIFtmZmZmZWEwMDAwMDAwMDAwLWZmZmZlYTAwMTAxZmZmZmZd
IFBNRCAtPiBbZmZmZjg4MDNmODYwMDAwMC1mZmZmODgwNDA3ZGZmZmZmXSBvbiBub2RlIDANClsg
ICAgMC4wMDAwMDBdICBbZmZmZmVhMDAxMGEwMDAwMC1mZmZmZWEwMDIwMWZmZmZmXSBQTUQgLT4g
W2ZmZmY4ODA3Zjg2MDAwMDAtZmZmZjg4MDgwN2RmZmZmZl0gb24gbm9kZSAxDQpbICAgIDAuMDAw
MDAwXSAgW2ZmZmZlYTAwMjBhMDAwMDAtZmZmZmVhMDAzMDFmZmZmZl0gUE1EIC0+IFtmZmZmODgw
YmY4NjAwMDAwLWZmZmY4ODBjMDdkZmZmZmZdIG9uIG5vZGUgMg0KWyAgICAwLjAwMDAwMF0gIFtm
ZmZmZWEwMDMwYTAwMDAwLWZmZmZlYTAwNDAxZmZmZmZdIFBNRCAtPiBbZmZmZjg4MGZmODYwMDAw
MC1mZmZmODgxMDA3ZGZmZmZmXSBvbiBub2RlIDMNClsgICAgMC4wMDAwMDBdICBbZmZmZmVhMDA0
MGEwMDAwMC1mZmZmZWEwMDUwMWZmZmZmXSBQTUQgLT4gW2ZmZmY4ODEzZjg2MDAwMDAtZmZmZjg4
MTQwN2RmZmZmZl0gb24gbm9kZSA0DQpbICAgIDAuMDAwMDAwXSAgW2ZmZmZlYTAwNTBhMDAwMDAt
ZmZmZmVhMDA2MDFmZmZmZl0gUE1EIC0+IFtmZmZmODgxN2Y3ZTAwMDAwLWZmZmY4ODE4MDc1ZmZm
ZmZdIG9uIG5vZGUgNQ0KDQpJZiBJIHJlbWVtYmVyIGNvcnJlY3RseSB0aGVyZSB3YXMgYSBtaXgg
b2YgNEdCIGFuZCA4R0IgRElNTXMgcG9wdWxhdGVkIG9uIHRoaXMgc3lzdGVtLiBJbiBhZGRpdGlv
biB0aGUgZmlybXdhcmUgcmVzZXJ2ZWQgNTEyTUJ5dGUgYXQgdGhlIGVuZCBvZiBlYWNoIG1lbW9y
eSBjb250cm9sbGVycyBwaHlzaWNhbCByYW5nZSAoaGVuY2UgdGhlIHJlc2VydmVkIHJhbmdlcyBp
biB0aGUgZTgyMCBtYXApLg0KDQpOb3RlOiB0aGlzIHdhcyB3aXRoIDQuMS4wIHZhbmlsbGEgc28g
aXQgY291bGQgYmUgb2Jzb2xldGUgbm93IHdpdGggNC4yLXJjLiBJIGhhdmUgbm90IHlldCB0ZXN0
ZWQgd2l0aCB5b3VyIGxhdGVzdCBwYXRjaGVzIHRoYXQgeW91IGFuZCBUb255IGRpc2N1c3NlZC4N
Cg0KDQpDaGVlcnMsDQpTdGVmZmVuDQoNCg0K
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

[toc] | [prev] | [next] | [standalone]


#1215412

FromYinghai Lu <yinghai@kernel.org>
Date2015-08-28 18:00 +0200
Message-ID<q2uem-7Lf-9@gated-at.bofh.it>
In reply to#1215184
On Thu, Aug 27, 2015 at 11:42 PM, Steffen Persvold <sp@numascale.com> wrote:
>>Can you post whole log with SRAT related info?
>
> I can probably reproduce again and get full logs when I get run time on the system again, but here’s some output that we saved in our internal Jira case :
>
> [    0.000000] NUMA: Initialized distance table, cnt=6
> [    0.000000] NUMA: Node 0 [mem 0x00000000-0x0009ffff] + [mem 0x00100000-0xd7ffffff] -> [mem 0x00000000-0xd7ffffff]
> [    0.000000] NUMA: Node 0 [mem 0x00000000-0xd7ffffff] + [mem 0x100000000-0x427ffffff] -> [mem 0x00000000-0x427ffffff]
> [    0.000000] NODE_DATA(0) allocated [mem 0x407fe3000-0x407ffffff]
> [    0.000000] NODE_DATA(1) allocated [mem 0x807fe3000-0x807ffffff]
> [    0.000000] NODE_DATA(2) allocated [mem 0xc07fe3000-0xc07ffffff]
> [    0.000000] NODE_DATA(3) allocated [mem 0x1007fe3000-0x1007ffffff]
> [    0.000000] NODE_DATA(4) allocated [mem 0x1407fe3000-0x1407ffffff]
> [    0.000000] NODE_DATA(5) allocated [mem 0x1807fdd000-0x1807ff9fff]
> [    0.000000]  [ffffea0000000000-ffffea00101fffff] PMD -> [ffff8803f8600000-ffff880407dfffff] on node 0
> [    0.000000]  [ffffea0010a00000-ffffea00201fffff] PMD -> [ffff8807f8600000-ffff880807dfffff] on node 1
> [    0.000000]  [ffffea0020a00000-ffffea00301fffff] PMD -> [ffff880bf8600000-ffff880c07dfffff] on node 2
> [    0.000000]  [ffffea0030a00000-ffffea00401fffff] PMD -> [ffff880ff8600000-ffff881007dfffff] on node 3
> [    0.000000]  [ffffea0040a00000-ffffea00501fffff] PMD -> [ffff8813f8600000-ffff881407dfffff] on node 4
> [    0.000000]  [ffffea0050a00000-ffffea00601fffff] PMD -> [ffff8817f7e00000-ffff8818075fffff] on node 5
>
> If I remember correctly there was a mix of 4GB and 8GB DIMMs populated on this system. In addition the firmware reserved 512MByte at the end of each memory controllers physical range (hence the reserved ranges in the e820 map).
>
> Note: this was with 4.1.0 vanilla so it could be obsolete now with 4.2-rc. I have not yet tested with your latest patches that you and Tony discussed.

We still need to see your srat table layout.

like the one from Tony's setup.

[    0.000000] SRAT: Node 0 PXM 0 [mem 0x00000000-0x7fffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x100000000-0xfffffffff]
[    0.000000] SRAT: Node 0 PXM 0 [mem 0x1000000000-0x1d6fffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x1d70000000-0x2c17ffffff]
[    0.000000] SRAT: Node 1 PXM 1 [mem 0x2c18000000-0x3abfffffff]
[    0.000000] SRAT: Node 2 PXM 2 [mem 0x3ac0000000-0x4967ffffff]
[    0.000000] SRAT: Node 2 PXM 2 [mem 0x4968000000-0x580fffffff]
[    0.000000] SRAT: Node 3 PXM 3 [mem 0x5810000000-0x66b7ffffff]
[    0.000000] SRAT: Node 3 PXM 3 [mem 0x66b8000000-0x755fffffff]
[    0.000000] NUMA: Initialized distance table, cnt=4
[    0.000000] NUMA: Node 0 [mem 0x00000000-0x7fffffff] + [mem
0x100000000-0xfffffffff] -> [mem 0x00000000-0xfffffffff]
[    0.000000] NUMA: Node 0 [mem 0x00000000-0xfffffffff] + [mem
0x1000000000-0x1d6fffffff] -> [mem 0x00000000-0x1d6fffffff]
[    0.000000] NUMA: Node 1 [mem 0x1d70000000-0x2c17ffffff] + [mem
0x2c18000000-0x3abfffffff] -> [mem 0x1d70000000-0x3abfffffff]
[    0.000000] NUMA: Node 2 [mem 0x3ac0000000-0x4967ffffff] + [mem
0x4968000000-0x580fffffff] -> [mem 0x3ac0000000-0x580fffffff]
[    0.000000] NUMA: Node 3 [mem 0x5810000000-0x66b7ffffff] + [mem
0x66b8000000-0x755fffffff] -> [mem 0x5810000000-0x755fffffff]
--
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@vger.kernel.org
More majordomo info at  http://vger.kernel.org/majordomo-info.html
Please read the FAQ at  http://www.tux.org/lkml/

[toc] | [prev] | [standalone]


Back to top | Article view | linux.kernel


csiph-web