Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.kernel > #87053 > unrolled thread

Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4

Back to article view | Back to linux.debian.kernel

Contents

  Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de> - 2025-04-25 11:40 +0200
    Processed: Re: linux: Please build with CONFIG_KERNEL_GZIP=y  instead of CONFIG_KERNEL_XZ=y on sh4 "Debian Bug Tracking System" <owner@bugs.debian.org> - 2025-05-02 19:00 +0200
    Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 Ben Hutchings <ben@decadent.org.uk> - 2025-05-02 19:00 +0200
      Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de> - 2025-05-02 20:10 +0200
        Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 Ben Hutchings <ben@decadent.org.uk> - 2025-05-02 20:20 +0200
          Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de> - 2025-05-02 20:20 +0200
      Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 Ben Hutchings <ben@decadent.org.uk> - 2025-05-02 21:00 +0200
    Processed: Re: linux: Please build with CONFIG_KERNEL_GZIP=y  instead of CONFIG_KERNEL_XZ=y on sh4 "Debian Bug Tracking System" <owner@bugs.debian.org> - 2025-05-02 20:20 +0200
    Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 Ben Hutchings <ben@decadent.org.uk> - 2025-05-02 20:20 +0200
      Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de> - 2025-05-02 20:20 +0200
        Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4 Ben Hutchings <ben@decadent.org.uk> - 2025-05-02 20:30 +0200
    Bug#1104080: marked as done (linux: Please build with  CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4) "Debian Bug Tracking System" <owner@bugs.debian.org> - 2025-05-09 22:50 +0200

#87053 — Bug#1104080: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4

Source: linux
Version: 6.12.22-1
Severity: normal
User: debian-superh@lists.debian.org
Usertags: sh4
X-Debbugs-Cc: debian-superh@lists.debian.org

Hello,

src:linux currently fails to build from source on sh4 due to the kernel
image compression set to XZ (CONFIG_KERNEL_XZ=y). I tried setting the
compression to GZIP (CONFIG_KERNEL_GZIP=y) in debian/config/sh4/config
and disabling CONFIG_KERNEL_XZ with the following configuration:

##
## file: init/Kconfig
##
## choice: Kernel compression mode
#. Decompression is done by the bootloader, so we need to be
#. conservative here.
CONFIG_KERNEL_GZIP=y
# CONFIG_KERNEL_XZ is not set
# CONFIG_KERNEL_ZSTD is not set
## end choice
## choice: Compiler optimization level
CONFIG_CC_OPTIMIZE_FOR_SIZE=y
## end choice

But for some reason that still resulted in CONFIG_KERNEL_XZ=y ending up
in the .config file of the sh7751lr kernel image.

However, I can enter the schroot after the failed build, edit the .config
files in /build/reproducible-path/linux-6.12.22/debian/build/build_sh4_none_sh7751r
and manually set CONFIG_KERNEL_GZIP=y and # CONFIG_KERNEL_XZ is not set which
makes the kernel build succeed when just running "make".

Thus, could you modify the configuration on sh4 such that the kernel is
compressed with GZIP instead of XZ (and ZSTD) by default so that the
kernel package builds again on sh4?

Using XZ doesn't make sense on sh4 with its small image sizes anyway.

Thanks,
Adrian

--
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer
`. `'   Physicist
  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913

[toc] | [next] | [standalone]

#87301 — Processed: Re: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4

Processing control commands:

> tag -1 moreinfo
Bug #1104080 [src:linux] linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4
Added tag(s) moreinfo.

-- 
1104080: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1104080
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems

[toc] | [prev] | [next] | [standalone]

#87302

[Multipart message — attachments visible in raw view] — view raw

Control: tag -1 moreinfo

On Fri, 25 Apr 2025 11:38:14 +0200 John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de> wrote:
> Source: linux
> Version: 6.12.22-1
> Severity: normal
> User: debian-superh@lists.debian.org
> Usertags: sh4
> X-Debbugs-Cc: debian-superh@lists.debian.org
> 
> Hello,
> 
> src:linux currently fails to build from source on sh4 due to the kernel
> image compression set to XZ (CONFIG_KERNEL_XZ=y).

You didn't say exactly why xz is a problem, but looking at the logs I
see xz sometimes failing with an out-of-memory error.

Are the sh4 builds running natively?

> I tried setting the
> compression to GZIP (CONFIG_KERNEL_GZIP=y) in debian/config/sh4/config
> and disabling CONFIG_KERNEL_XZ with the following configuration:
> 
> ##
> ## file: init/Kconfig
> ##
> ## choice: Kernel compression mode
> #. Decompression is done by the bootloader, so we need to be
> #. conservative here.
> CONFIG_KERNEL_GZIP=y
> # CONFIG_KERNEL_XZ is not set
> # CONFIG_KERNEL_ZSTD is not set
> ## end choice
> ## choice: Compiler optimization level
> CONFIG_CC_OPTIMIZE_FOR_SIZE=y
> ## end choice
> 
> But for some reason that still resulted in CONFIG_KERNEL_XZ=y ending up
> in the .config file of the sh7751lr kernel image.

That change should work, and it does work for me.
 
> However, I can enter the schroot after the failed build, edit the .config
> files in /build/reproducible-path/linux-6.12.22/debian/build/build_sh4_none_sh7751r
> and manually set CONFIG_KERNEL_GZIP=y and # CONFIG_KERNEL_XZ is not set which
> makes the kernel build succeed when just running "make".
> 
> Thus, could you modify the configuration on sh4 such that the kernel is
> compressed with GZIP instead of XZ (and ZSTD) by default so that the
> kernel package builds again on sh4?
> 
> Using XZ doesn't make sense on sh4 with its small image sizes anyway.

Well, speaking of that, you have not yet reported back on whether my
fix-sh7785lcr branch works.  I just rebased this and uploaded fresh
packages to <https://people.debian.org/~benh/packages/linux-sh4/>.

If we apply this config change on top of that, the kernel image size for
sh7785lcr will again go over the 4 MiB limit.  So we would need to
either (1) trim the config further or (2) drop the sh7785lcr flavour.  I
do not intend to spend more time on (1) so this is really up to you (or
other sh4 porters) now.

Ben.

-- 
Ben Hutchings
It's easier to fight for one's principles than to live up to them.

[toc] | [prev] | [next] | [standalone]

#87304

Hi,

On Fri, 2025-05-02 at 18:54 +0200, Ben Hutchings wrote:
> > src:linux currently fails to build from source on sh4 due to the kernel
> > image compression set to XZ (CONFIG_KERNEL_XZ=y).
> 
> You didn't say exactly why xz is a problem, but looking at the logs I
> see xz sometimes failing with an out-of-memory error.

Sorry, I thought I mentioned this.

> Are the sh4 builds running natively?

They're qemu-based except for tirpitz which is a native machine (actual hardware)

> > I tried setting the
> > compression to GZIP (CONFIG_KERNEL_GZIP=y) in debian/config/sh4/config
> > and disabling CONFIG_KERNEL_XZ with the following configuration:
> > 
> > ##
> > ## file: init/Kconfig
> > ##
> > ## choice: Kernel compression mode
> > #. Decompression is done by the bootloader, so we need to be
> > #. conservative here.
> > CONFIG_KERNEL_GZIP=y
> > # CONFIG_KERNEL_XZ is not set
> > # CONFIG_KERNEL_ZSTD is not set
> > ## end choice
> > ## choice: Compiler optimization level
> > CONFIG_CC_OPTIMIZE_FOR_SIZE=y
> > ## end choice
> > 
> > But for some reason that still resulted in CONFIG_KERNEL_XZ=y ending up
> > in the .config file of the sh7751lr kernel image.
> 
> That change should work, and it does work for me.
>  
> > However, I can enter the schroot after the failed build, edit the .config
> > files in /build/reproducible-path/linux-6.12.22/debian/build/build_sh4_none_sh7751r
> > and manually set CONFIG_KERNEL_GZIP=y and # CONFIG_KERNEL_XZ is not set which
> > makes the kernel build succeed when just running "make".
> > 
> > Thus, could you modify the configuration on sh4 such that the kernel is
> > compressed with GZIP instead of XZ (and ZSTD) by default so that the
> > kernel package builds again on sh4?
> > 
> > Using XZ doesn't make sense on sh4 with its small image sizes anyway.
> 
> Well, speaking of that, you have not yet reported back on whether my
> fix-sh7785lcr branch works.  I just rebased this and uploaded fresh
> packages to <https://people.debian.org/~benh/packages/linux-sh4/>.
> 
> If we apply this config change on top of that, the kernel image size for
> sh7785lcr will again go over the 4 MiB limit.  So we would need to
> either (1) trim the config further or (2) drop the sh7785lcr flavour.  I
> do not intend to spend more time on (1) so this is really up to you (or
> other sh4 porters) now.

Yes, this is still on my TODO list and I have not forgotten it. I will eventually
come back to this. Currently, the main priority is maintaining the kernel upstream
as well as getting the SH backend in GCC converted to LRA which is coordinated with
people from the Dreamcast community.

Adrian

-- 
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer
`. `'   Physicist
  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913

[toc] | [prev] | [next] | [standalone]

#87306

[Multipart message — attachments visible in raw view] — view raw

Control: tag -1 - moreinfo

On Fri, 2025-05-02 at 19:59 +0200, John Paul Adrian Glaubitz wrote:
> Hi,
> 
> On Fri, 2025-05-02 at 18:54 +0200, Ben Hutchings wrote:
[...]
> > 
> > > Using XZ doesn't make sense on sh4 with its small image sizes anyway.
> > 
> > Well, speaking of that, you have not yet reported back on whether my
> > fix-sh7785lcr branch works.  I just rebased this and uploaded fresh
> > packages to <https://people.debian.org/~benh/packages/linux-sh4/>.
> > 
> > If we apply this config change on top of that, the kernel image size for
> > sh7785lcr will again go over the 4 MiB limit.  So we would need to
> > either (1) trim the config further or (2) drop the sh7785lcr flavour.  I
> > do not intend to spend more time on (1) so this is really up to you (or
> > other sh4 porters) now.
> 
> Yes, this is still on my TODO list and I have not forgotten it. I will eventually
> come back to this. Currently, the main priority is maintaining the kernel upstream
> as well as getting the SH backend in GCC converted to LRA which is coordinated with
> people from the Dreamcast community.

Then I will drop that flavour, and you can re-add it when you are ready
to do so.

Ben.

-- 
Ben Hutchings
Absolutum obsoletum. (If it works, it's out of date.) - Stafford Beer

[toc] | [prev] | [next] | [standalone]

#87309

On Fri, 2025-05-02 at 20:08 +0200, Ben Hutchings wrote:
> > Yes, this is still on my TODO list and I have not forgotten it. I will eventually
> > come back to this. Currently, the main priority is maintaining the kernel upstream
> > as well as getting the SH backend in GCC converted to LRA which is coordinated with
> > people from the Dreamcast community.
> 
> Then I will drop that flavour, and you can re-add it when you are ready
> to do so.

Why do you need to drop it? I don't understand the reasoning behind it.

Does it hurt in any way when that flavor is being built?

Adrian

-- 
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer
`. `'   Physicist
  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913

[toc] | [prev] | [next] | [standalone]

#87313

[Multipart message — attachments visible in raw view] — view raw

On Fri, 2025-05-02 at 18:54 +0200, Ben Hutchings wrote:
> Control: tag -1 moreinfo
> 
> On Fri, 25 Apr 2025 11:38:14 +0200 John Paul Adrian Glaubitz <glaubitz@physik.fu-berlin.de> wrote:
> > Source: linux
> > Version: 6.12.22-1
> > Severity: normal
> > User: debian-superh@lists.debian.org
> > Usertags: sh4
> > X-Debbugs-Cc: debian-superh@lists.debian.org
> > 
> > Hello,
> > 
> > src:linux currently fails to build from source on sh4 due to the kernel
> > image compression set to XZ (CONFIG_KERNEL_XZ=y).
> 
> You didn't say exactly why xz is a problem, but looking at the logs I
> see xz sometimes failing with an out-of-memory error.
[...]

By the way, this seems to be due to:

commit 8653c909922743bceb4800e5cc26087208c9e0e6
Author: Lasse Collin <lasse.collin@tukaani.org>
Date:   Sun Jul 21 16:36:28 2024 +0300
 
    xz: use 128 MiB dictionary and force single-threaded mode

which causes xz to allocate 1346 MiB (!) at build time.

If you have the time, it might be worth trying to add an option to use a
smaller dictionary size again.

Ben.

-- 
Ben Hutchings
Absolutum obsoletum. (If it works, it's out of date.) - Stafford Beer

[toc] | [prev] | [next] | [standalone]

#87305 — Processed: Re: linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4

Processing control commands:

> tag -1 - moreinfo
Bug #1104080 [src:linux] linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4
Removed tag(s) moreinfo.

-- 
1104080: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1104080
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems

[toc] | [prev] | [next] | [standalone]

#87307

[Multipart message — attachments visible in raw view] — view raw

On Fri, 2025-05-02 at 20:10 +0200, John Paul Adrian Glaubitz wrote:
> On Fri, 2025-05-02 at 20:08 +0200, Ben Hutchings wrote:
> > > Yes, this is still on my TODO list and I have not forgotten it. I will eventually
> > > come back to this. Currently, the main priority is maintaining the kernel upstream
> > > as well as getting the SH backend in GCC converted to LRA which is coordinated with
> > > people from the Dreamcast community.
> > 
> > Then I will drop that flavour, and you can re-add it when you are ready
> > to do so.
> 
> Why do you need to drop it? I don't understand the reasoning behind it.
> 
> Does it hurt in any way when that flavor is being built?

We know that it currently can't work.  So it is wasting the time of the
builders and of anyone who tries to use it.

Ben.

-- 
Ben Hutchings
Absolutum obsoletum. (If it works, it's out of date.) - Stafford Beer

[toc] | [prev] | [next] | [standalone]

#87308

On Fri, 2025-05-02 at 20:12 +0200, Ben Hutchings wrote:
> > Why do you need to drop it? I don't understand the reasoning behind it.
> > 
> > Does it hurt in any way when that flavor is being built?
> 
> We know that it currently can't work.  So it is wasting the time of the
> builders and of anyone who tries to use it.

I'm maintaining those builders and I'm fine with that. It allows me to catch
regressions when looking at build logs.

Adrian

-- 
 .''`.  John Paul Adrian Glaubitz
: :' :  Debian Developer
`. `'   Physicist
  `-    GPG: 62FF 8A75 84E0 2956 9546  0006 7426 3B37 F5B5 F913

[toc] | [prev] | [next] | [standalone]

#87310

[Multipart message — attachments visible in raw view] — view raw

On Fri, 2025-05-02 at 20:13 +0200, John Paul Adrian Glaubitz wrote:
> On Fri, 2025-05-02 at 20:12 +0200, Ben Hutchings wrote:
> > > Why do you need to drop it? I don't understand the reasoning behind it.
> > > 
> > > Does it hurt in any way when that flavor is being built?
> > 
> > We know that it currently can't work.  So it is wasting the time of the
> > builders and of anyone who tries to use it.
> 
> I'm maintaining those builders and I'm fine with that. It allows me to catch
> regressions when looking at build logs.

There is nothing stopping you from doing your own kernel builds to test
whatever configuration and drivers you want.

Meanwhile in src:linux I think we only want to provide configurations
that are actually useful.

Ben.

-- 
Ben Hutchings
Absolutum obsoletum. (If it works, it's out of date.) - Stafford Beer

[toc] | [prev] | [next] | [standalone]

#87491 — Bug#1104080: marked as done (linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4)

[Multipart message — attachments visible in raw view] — view raw

Your message dated Fri, 09 May 2025 20:41:33 +0000
with message-id <E1uDUXF-009fU3-8u@fasolo.debian.org>
and subject line Bug#1104080: fixed in linux 6.14.6-1~exp1
has caused the Debian Bug report #1104080,
regarding linux: Please build with CONFIG_KERNEL_GZIP=y instead of CONFIG_KERNEL_XZ=y on sh4
to be marked as done.

This means that you claim that the problem has been dealt with.
If this is not the case it is now your responsibility to reopen the
Bug report if necessary, and/or fix the problem forthwith.

(NB: If you are a system administrator and have no idea what this
message is talking about, this may indicate a serious mail system
misconfiguration somewhere. Please contact owner@bugs.debian.org
immediately.)


-- 
1104080: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=1104080
Debian Bug Tracking System
Contact owner@bugs.debian.org with problems

[toc] | [prev] | [standalone]

Back to top | Article view | linux.debian.kernel

csiph-web