Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.kernel > #1306256 > unrolled thread

Re: v4.4-rc8 based tip tree kernel hangs on boot.

Back to article view | Back to linux.kernel

This discussion starts older than the indexed window; earlier articles aren't shown. The article labeled Started by below is the oldest one visible, not the original post.

Contents

  Re: v4.4-rc8 based tip tree kernel hangs on boot. Matt Fleming <matt@codeblueprint.co.uk> - 2016-01-11 15:10 +0100
    Re: v4.4-rc8 based tip tree kernel hangs on boot. Ingo Molnar <mingo@kernel.org> - 2016-01-11 16:20 +0100
      Re: v4.4-rc8 based tip tree kernel hangs on boot. Srikar Dronamraju <srikar@linux.vnet.ibm.com> - 2016-01-11 17:50 +0100
    Re: v4.4-rc8 based tip tree kernel hangs on boot. Ingo Molnar <mingo@kernel.org> - 2016-01-12 11:40 +0100
      Re: v4.4-rc8 based tip tree kernel hangs on boot. Matt Fleming <matt@codeblueprint.co.uk> - 2016-01-14 13:30 +0100

#1306256 — Re: v4.4-rc8 based tip tree kernel hangs on boot.

On Mon, 11 Jan, at 12:59:21AM, Srikar Dronamraju wrote:
> On a x86_64 machine, I see kernel v4.4-rc8 based tip tree hangs on boot.
> However v4.4-rc8 with the same config boots well on the same machine.
> 
> git bisect results are as follows
> 
> git bisect start
> # bad: [fc4e8fa9f80e0f099838f3a9997019de36d9a4ba] Merge branch 'WIP.x86/mm'
> git bisect bad fc4e8fa9f80e0f099838f3a9997019de36d9a4ba
> # good: [168309855a7d1e16db751e9c647119fe2d2dc878] Linux 4.4-rc8
> git bisect good 168309855a7d1e16db751e9c647119fe2d2dc878
> # good: [76e17c25ebc9f6619f9f8fd93f3905b0def8dc6f] Merge branch 'perf/core'
> git bisect good 76e17c25ebc9f6619f9f8fd93f3905b0def8dc6f
> # good: [e8998ce7e8ce42419d0c7bb08c105bd860eb3218] Merge branch 'timers/urgent'
> git bisect good e8998ce7e8ce42419d0c7bb08c105bd860eb3218
> # good: [af51cdabdbea5355ed388b8b3a7cf9bfc0864b9c] Merge branch 'x86/cpu'
> git bisect good af51cdabdbea5355ed388b8b3a7cf9bfc0864b9c
> # bad: [5852b88267adcc78722fc5d4f45751fb6e261bd2] Merge branch 'x86/urgent'
> git bisect bad 5852b88267adcc78722fc5d4f45751fb6e261bd2
> # bad: [c236714fd39fb26993af2d5fde9c3bfc32361323] Merge branch 'x86/fpu'
> git bisect bad c236714fd39fb26993af2d5fde9c3bfc32361323
> # bad: [ff3d0a12fb2dc123e2b46e9524ebf4e08de5c59c] Documentation/x86: Update EFI memory region description
> git bisect bad ff3d0a12fb2dc123e2b46e9524ebf4e08de5c59c
> # bad: [b61a76f8850d2979550abc42d7e09154ebb8d785] x86/efi: Map RAM into the identity page table for mixed mode
> git bisect bad b61a76f8850d2979550abc42d7e09154ebb8d785
> # bad: [edc3b9129cecd0f0857112136f5b8b1bc1d45918] x86/mm/pat: Ensure cpa->pfn only contains page frame numbers
> git bisect bad edc3b9129cecd0f0857112136f5b8b1bc1d45918
> # bad: [21cdb6b568435738cc0b303b2b3b82742396310c] x86/mm: Page align the '_end' symbol to avoid pfn conversion bugs
> git bisect bad 21cdb6b568435738cc0b303b2b3b82742396310c
> # first bad commit: [21cdb6b568435738cc0b303b2b3b82742396310c] x86/mm: Page align the '_end' symbol to avoid pfn conversion bugs
> 
> Not much info on the console, when the kernel hangs.
 
What info is there?

> Tried reverting Commit 21cdb6b56 "x86/mm: Page align the '_end'
> symbol to avoid pfn conversion bugs" but that doesnt help.

Odd. Could you try booting the tip/x86/efi branch instead? There's
only a handful of patches on that branch so it should be pretty easy
to narrow down the problematic change.

[toc] | [next] | [standalone]

#1306382

* Matt Fleming <matt@codeblueprint.co.uk> wrote:

> On Mon, 11 Jan, at 12:59:21AM, Srikar Dronamraju wrote:
> > On a x86_64 machine, I see kernel v4.4-rc8 based tip tree hangs on boot.
> > However v4.4-rc8 with the same config boots well on the same machine.
> > 
> > git bisect results are as follows
> > 
> > git bisect start
> > # bad: [fc4e8fa9f80e0f099838f3a9997019de36d9a4ba] Merge branch 'WIP.x86/mm'
> > git bisect bad fc4e8fa9f80e0f099838f3a9997019de36d9a4ba
> > # good: [168309855a7d1e16db751e9c647119fe2d2dc878] Linux 4.4-rc8
> > git bisect good 168309855a7d1e16db751e9c647119fe2d2dc878
> > # good: [76e17c25ebc9f6619f9f8fd93f3905b0def8dc6f] Merge branch 'perf/core'
> > git bisect good 76e17c25ebc9f6619f9f8fd93f3905b0def8dc6f
> > # good: [e8998ce7e8ce42419d0c7bb08c105bd860eb3218] Merge branch 'timers/urgent'
> > git bisect good e8998ce7e8ce42419d0c7bb08c105bd860eb3218
> > # good: [af51cdabdbea5355ed388b8b3a7cf9bfc0864b9c] Merge branch 'x86/cpu'
> > git bisect good af51cdabdbea5355ed388b8b3a7cf9bfc0864b9c
> > # bad: [5852b88267adcc78722fc5d4f45751fb6e261bd2] Merge branch 'x86/urgent'
> > git bisect bad 5852b88267adcc78722fc5d4f45751fb6e261bd2
> > # bad: [c236714fd39fb26993af2d5fde9c3bfc32361323] Merge branch 'x86/fpu'
> > git bisect bad c236714fd39fb26993af2d5fde9c3bfc32361323
> > # bad: [ff3d0a12fb2dc123e2b46e9524ebf4e08de5c59c] Documentation/x86: Update EFI memory region description
> > git bisect bad ff3d0a12fb2dc123e2b46e9524ebf4e08de5c59c
> > # bad: [b61a76f8850d2979550abc42d7e09154ebb8d785] x86/efi: Map RAM into the identity page table for mixed mode
> > git bisect bad b61a76f8850d2979550abc42d7e09154ebb8d785
> > # bad: [edc3b9129cecd0f0857112136f5b8b1bc1d45918] x86/mm/pat: Ensure cpa->pfn only contains page frame numbers
> > git bisect bad edc3b9129cecd0f0857112136f5b8b1bc1d45918
> > # bad: [21cdb6b568435738cc0b303b2b3b82742396310c] x86/mm: Page align the '_end' symbol to avoid pfn conversion bugs
> > git bisect bad 21cdb6b568435738cc0b303b2b3b82742396310c
> > # first bad commit: [21cdb6b568435738cc0b303b2b3b82742396310c] x86/mm: Page align the '_end' symbol to avoid pfn conversion bugs
> > 
> > Not much info on the console, when the kernel hangs.
>  
> What info is there?
> 
> > Tried reverting Commit 21cdb6b56 "x86/mm: Page align the '_end'
> > symbol to avoid pfn conversion bugs" but that doesnt help.
> 
> Odd. Could you try booting the tip/x86/efi branch instead? There's
> only a handful of patches on that branch so it should be pretty easy
> to narrow down the problematic change.

Yes, that would be nice, you can get it via:

  git checkout v4.4
  git pull git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git x86/efi

Meanwhile I'm holding off on sending the pending EFI bits to Linus, conditional on 
the outcome of this regression report.

Thanks,

	Ingo

[toc] | [prev] | [next] | [standalone]

#1306502

> >  
> > What info is there?
> > 

https://goo.gl/photos/1izrwCtAWj8aK7hi7
Unfortunately I am unable to get a text console. So this is all I see.


> > > Tried reverting Commit 21cdb6b56 "x86/mm: Page align the '_end'
> > > symbol to avoid pfn conversion bugs" but that doesnt help.
> > 
> > Odd. Could you try booting the tip/x86/efi branch instead? There's
> > only a handful of patches on that branch so it should be pretty easy
> > to narrow down the problematic change.
> 
> Yes, that would be nice, you can get it via:
> 

# git reset --hard tip/x86/efi
HEAD is now at e2c90dd x86/efi-bgrt: Replace early_memremap() with memremap()

Tried to boot with the above commit; but it doesnt boot.

-- 
Thanks and Regards
Srikar

>   git checkout v4.4
>   git pull git://git.kernel.org/pub/scm/linux/kernel/git/tip/tip.git x86/efi
> 
> Meanwhile I'm holding off on sending the pending EFI bits to Linus, conditional on 
> the outcome of this regression report.
> 
> Thanks,
> 
> 	Ingo
> 

-- 
Thanks and Regards
Srikar Dronamraju

[toc] | [prev] | [next] | [standalone]

#1307239

* Matt Fleming <matt@codeblueprint.co.uk> wrote:

> > Tried reverting Commit 21cdb6b56 "x86/mm: Page align the '_end'
> > symbol to avoid pfn conversion bugs" but that doesnt help.
> 
> Odd. Could you try booting the tip/x86/efi branch instead? There's
> only a handful of patches on that branch so it should be pretty easy
> to narrow down the problematic change.

So he already appears to have done that, when performing the bisection:

 # first bad commit: [21cdb6b568435738cc0b303b2b3b82742396310c] x86/mm: Page align the '_end' symbol to avoid pfn conversion bugs

commit 21cdb6b568 is part of tip:x86/efi:

 triton:~/tip> gll linus..x86/efi
 e2c90dd7e11e x86/efi-bgrt: Replace early_memremap() with memremap()
 98f91276900f Merge tag 'efi-next' of git://git.kernel.org/pub/scm/linux/kernel/git/mfleming/efi into x86/efi
 50a0cb565246 x86/efi-bgrt: Fix kernel panic when mapping BGRT data
 26d7f65fbd22 x86/efi: Preface all print statements with efi* tag
 3bb9eee61c64 doc: efi-stub.txt: Fix arm64 paths
 7f83773ced2f efi/esrt: Don't preformat name
 ff3d0a12fb2d Documentation/x86: Update EFI memory region description
 67a9108ed431 x86/efi: Build our own page table structures
 c9f2a9a65e48 x86/efi: Hoist page table switching code into efi_call_virt()
 b61a76f8850d x86/efi: Map RAM into the identity page table for mixed mode
 edc3b9129cec x86/mm/pat: Ensure cpa->pfn only contains page frame numbers
 21cdb6b56843 x86/mm: Page align the '_end' symbol to avoid pfn conversion bugs

it's the first commit in the branch in fact.

To double check, it would be nice to check that applying that commit to v4.4 
breaks the boot too:

  git checkout v4.4
  git cherry-pick 21cdb6b568

... but assuming the bisection is reliable, I'd say the evidence is pretty 
conclusive already.

Srikar, could you please send the good and bad System.map files, so that we see 
what the effects of the aligning were? The two interesting sha1's to test are:

  21cdb6b56843: first bad commit
  6ffeba960734: last good commit (parent commit of 21cdb6b56843)

Thanks,

	Ingo

[toc] | [prev] | [next] | [standalone]

#1309228

On Tue, 12 Jan, at 11:30:44AM, Ingo Molnar wrote:
> 
> Srikar, could you please send the good and bad System.map files, so that we see 
> what the effects of the aligning were? The two interesting sha1's to test are:
> 
>   21cdb6b56843: first bad commit
>   6ffeba960734: last good commit (parent commit of 21cdb6b56843)

Srikar any update here? This issue is holding up the merging of all
new EFI material for v4.5.

I was unable to reproduce your issue locally, what machine are you
running? From the hang picture it looks like some IBM machine, but if
you could provide more details that'd be useful.

[toc] | [prev] | [standalone]

Back to top | Article view | linux.kernel

csiph-web