Re: [buildd-tools-devel] Some Debian package upgrades are corrupting rsync "quick check" backups

From	Aurelien Jarno <aurelien@aurel32.net>
Newsgroups	linux.debian.security
Subject	Re: [buildd-tools-devel] Some Debian package upgrades are corrupting rsync "quick check" backups
Date	2017-08-28 12:40 +0200
Message-ID	<ujpCx-4si-11@gated-at.bofh.it> (permalink)
References	(5 earlier) <tGGwO-4VS-9@gated-at.bofh.it> <tGHCy-5CA-5@gated-at.bofh.it> <tGL3s-7WF-27@gated-at.bofh.it> <tGM9b-g8-11@gated-at.bofh.it> <ujlyW-1YD-11@gated-at.bofh.it>
Organization	linux.* mail to news gateway

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

On 2017-08-28 18:06, Adam Warner wrote:
> On Sat, 2017-05-13 at 22:48 +0200, Aurelien Jarno wrote:
> > On 2017-05-13 21:34, Aurelien Jarno wrote:
> > > On 2017-05-13 17:52, Mattia Rizzolo wrote:
> > > > On Sat, May 13, 2017 at 03:44:57PM +0100, Chris Lamb wrote:
> > > > >  a) Has anything changed in the meantime?
> > > > 
> > > > Yes: sbuild stopped repeating the changelog time taking it from
> > > > the last
> > > > entry, and will instead generate a new timestamp based on the
> > > > current
> > > > time:
> > > > 
> > > >   * For binNMUs, instead of copying the timestamp of the last
> > > > changelog entry,
> > > >     generate a new one (closes: #843773)
> > > > 
> > > > In version 0.73.0-1.
> > > 
> > > And I am glad that after all that months with people talking about
> > > the
> > > issue, I finally got a detailed description of the issue and a
> > > pointer
> > > to the commit to backport. I'll work on that.
> > 
> > The above change should now be deployed on most jessie based buildds,
> > it's only missing on the buildds that are currently down.
> 
> Original thread author here reporting to beware that some rsync data
> corruption can still become apparent after all this time.
> 
> It's been a while since I did a full rsync checksum test. Decided to do
> one after a recent upgrade that includes clang 3.9 related files. These
> are Debian systems that default to unstable BUT include all debian apt
> sources including experimental/unstable/testing/stable/oldstable.
> 
> I found these four corrupted files in my rsync backups:
> 
> var/lib/dpkg/info/clang-3.9.md5sums
> var/lib/dpkg/info/libclang-common-3.9-dev.md5sums
> var/lib/dpkg/info/libclang1-3.9:amd64.md5sums
> var/lib/dpkg/info/libllvm3.9:amd64.md5sums
> 
> The latest packages were installed from this repository:
> 
> Get:17 https://cdn-aws.deb.debian.org/debian unstable/main amd64 clang-3.9 amd64 1:3.9.1-11 [37.3 MB]
> Get:18 https://cdn-aws.deb.debian.org/debian unstable/main amd64 libclang-common-3.9-dev amd64 1:3.9.1-11 [2,587 kB]
> Get:19 https://cdn-aws.deb.debian.org/debian unstable/main amd64 libllvm3.9 amd64 1:3.9.1-11 [11.4 MB]
> Get:20 https://cdn-aws.deb.debian.org/debian unstable/main amd64 libclang1-3.9 amd64 1:3.9.1-11 [5,896 kB]                                                                  

These files haven't been built on a build daemon, but instead have
been uploaded by the maintainer [1]. This is therefore not a buildd
issue, the issue has been fixed there already with the upgrade to
stretch.

Aurelien

[1] https://tracker.debian.org/news/866006

-- 
Aurelien Jarno                          GPG: 4096R/1DDD8C9B
aurelien@aurel32.net                 http://www.aurel32.net

Thread

Some Debian package upgrades are corrupting rsync "quick check"  backups Adam Warner <lists@consulting.net.nz> - 2017-01-28 14:20 +0100
  Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Christoph Biedl <debian.axhn@manchmal.in-ulm.de> - 2017-01-28 15:00 +0100
  Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Daniel Reichelt <debian@nachtgeist.net> - 2017-01-28 15:50 +0100
    Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Holger Levsen <holger@layer-acht.org> - 2017-01-28 16:00 +0100
      Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Daniel Reichelt <debian@nachtgeist.net> - 2017-01-28 16:40 +0100
      Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Lupe Christoph <lupe@lupe-christoph.de> - 2017-01-28 23:10 +0100
        Re: Some Debian package upgrades are corrupting rsync "quick       check" backups "Jonathan Hutchins" <hutchins@tarcanfel.org> - 2017-01-29 00:10 +0100
        Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Santiago Vila <sanvila@unex.es> - 2017-01-29 20:30 +0100
          Re: Some Debian package upgrades are corrupting rsync "quick check" backups Russell Coker <russell@coker.com.au> - 2017-01-30 10:40 +0100
        Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Jonathan Wiltshire <jmw@debian.org> - 2017-01-29 21:20 +0100
        Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Henrik Ahlgren <pablo@seestieto.com> - 2017-01-30 13:10 +0100
          Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Mattia Rizzolo <mattia@debian.org> - 2017-01-30 13:20 +0100
            Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Holger Levsen <holger@layer-acht.org> - 2017-01-30 14:30 +0100
              Re: Some Debian package upgrades are corrupting rsync "quick check" backups Johannes Schauer <josch@debian.org> - 2017-01-30 15:00 +0100
                Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Holger Levsen <holger@layer-acht.org> - 2017-01-30 15:00 +0100
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting rsync  "quick check" backups Johannes Schauer <josch@debian.org> - 2017-01-30 16:30 +0100
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Chris Lamb <lamby@debian.org> - 2017-05-13 16:50 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Holger Levsen <holger@layer-acht.org> - 2017-05-13 18:00 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Mattia Rizzolo <mattia@debian.org> - 2017-05-13 18:00 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Aurelien Jarno <aurelien@aurel32.net> - 2017-05-13 21:40 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Aurelien Jarno <aurelien@aurel32.net> - 2017-05-13 22:50 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Holger Levsen <holger@layer-acht.org> - 2017-05-13 23:00 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are  corrupting rsync "quick check" backups Adam Warner <lists@consulting.net.nz> - 2017-08-28 08:20 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Aurelien Jarno <aurelien@aurel32.net> - 2017-08-28 12:40 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Aurelien Jarno <aurelien@aurel32.net> - 2017-08-28 12:50 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are corrupting  rsync "quick check" backups Aurelien Jarno <aurelien@aurel32.net> - 2017-08-28 13:00 +0200
                Re: [buildd-tools-devel] Some Debian package upgrades are  corrupting rsync "quick check" backups Adam Warner <lists@consulting.net.nz> - 2017-08-28 14:20 +0200
  Re: Some Debian package upgrades are corrupting rsync "quick check"  backups Bob Weber <bobrweber@gmail.com> - 2017-01-28 17:20 +0100

csiph-web