Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.project > #13911

Re: Salsa CI overload

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

On 2025-08-25 4 h 05 p.m., Ian Jackson wrote:
> Hi.
> 
> (I wasn't able to find another mailing list for this.  I found a bit
> of discussion on debian-devel about one specific overload incident.)
> 
> Since sid opened, people have naturally been hard at work.  Great!
> 
> But I notice that Salsa CI is now frequently very overloaded.  Even
> when it's not half a day behind (!), I often see that my package is
> able to run only about one job at a time.  I think this is slowing a
> lot of us down quite considerably.
> 
> It seems to me that we (Debian) could probably acquire more computing
> resources if we wanted.  Perhaps some of our jobs are wasteful, but I
> think that overall, adding capacity would be well justified.
> 
> I haven't seen any discussion of this anywhere.  Is work ongoing to
> try to add more capacity to Salsa CI?  What are the key difficulties?
> 
> If we knew what kind of expertise/assistance/input/sponsorship was
> needed, I feel we could probably find it within our project.
> 
> Thanks,
> Ian.
> 

I raised a similar issue during DebConf25 and it looks like some changes 
were made back then [1], as it seems to me Salsa CI is indeed faster 
than it used to be.

Generally though, Salsa CI is pretty underpowered, which definitely 
slows down my Debian work. Running the Lintian testsuite (which is a 
requirement to merge contributions) frequently takes more than 2 hours 
to run. On my local machine at home, it takes around 4 minutes :(

I feel like making people wait around for CI to run isn't a great use of 
our collective time.

IIUC, runners are currently sponsored machines running in the Google 
Cloud [2]. Maybe we could prod them again and ask for some more 
resources, pretty please?

[1]: many thanks to the folks who worked on that issue

[2]: 
https://salsa.debian.org/salsa/salsa-ansible/-/blob/master/inventories/prod/host_vars/salsa-runner.salsa-runner.debian.net.yml?ref_type=heads#L8-9

-- 
   ⢀⣴⠾⠻⢶⣦⠀
   ⣾⠁⢠⠒⠀⣿⡁  Louis-Philippe Véronneau
   ⢿⡄⠘⠷⠚⠋   pollo@debian.org / veronneau.org
   ⠈⠳⣄

Back to linux.debian.project | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Salsa CI overload Ian Jackson <ijackson@chiark.greenend.org.uk> - 2025-08-25 22:20 +0200
  Re: Salsa CI overload Louis-Philippe Véronneau <pollo@debian.org> - 2025-08-25 23:50 +0200
    Re: Salsa CI overload Simon Josefsson <simon@josefsson.org> - 2025-08-26 09:50 +0200
      Re: Salsa CI overload Louis-Philippe Véronneau <pollo@debian.org> - 2025-08-26 17:10 +0200
      Re: Salsa CI overload Otto Kekäläinen <otto@debian.org> - 2025-09-05 03:20 +0200
        Re: Salsa CI overload Lucas Nussbaum <lucas@debian.org> - 2025-09-05 15:40 +0200
          Re: Salsa CI overload Otto Kekäläinen <otto@debian.org> - 2025-09-05 19:40 +0200
            Re: Salsa CI overload Lucas Nussbaum <lucas@debian.org> - 2025-09-05 21:40 +0200
  Re: Salsa CI overload Alexander Wirt <formorer@debian.org> - 2025-08-27 00:30 +0200
    Re: Salsa CI overload Antoine Le Gonidec <vv221@debian.org> - 2025-08-27 01:30 +0200
      Re: Salsa CI overload Soren Stoutner <soren@debian.org> - 2025-08-27 23:50 +0200
      Re: Salsa CI overload Didier 'OdyX' Raboud <odyx@debian.org> - 2025-08-28 09:30 +0200
        salsa: unconditional rebuild of all reverse dependencies on every push considered abuse (was "Salsa CI overload") Antonio Terceiro <terceiro@debian.org> - 2025-08-28 15:00 +0200
          Re: salsa: unconditional rebuild of all reverse dependencies on every push considered abuse (was "Salsa CI overload") Jérémy Lal <kapouer@melix.org> - 2025-08-28 15:30 +0200
          Re: salsa: unconditional rebuild of all reverse dependencies on every push considered abuse (was "Salsa CI overload") Marco d'Itri <md@Linux.IT> - 2025-08-28 15:30 +0200
            Re: salsa: unconditional rebuild of all reverse dependencies on every push considered abuse (was "Salsa CI overload") Antonio Terceiro <terceiro@debian.org> - 2025-08-28 17:00 +0200
    Re: Salsa CI overload Ian Jackson <ijackson@chiark.greenend.org.uk> - 2025-08-27 11:40 +0200

csiph-web