Path: csiph.com!fu-berlin.de!bofh.it!news.nic.it!robomod From: Malik Mlitat Newsgroups: linux.debian.maint.python,linux.debian.bugs.dist Subject: Re: python3-openid: autopkgtest must be marked superficial Date: Sun, 29 Jan 2023 13:10:01 +0100 Message-ID: References: X-Mailbox-Line: From debian-python-request@lists.debian.org Sun Jan 29 12:09:25 2023 Old-Return-Path: X-Amavis-Spam-Status: No, score=-3.097 tagged_above=-10000 required=5.3 tests=[BAYES_00=-2, DIGITS_LETTERS=1, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, FREEMAIL_FROM=0.001, MD5_SHA1_SUM=-1, NICE_REPLY_A=-1.148, RCVD_IN_DNSWL_NONE=-0.0001] autolearn=no autolearn_force=no X-Policyd-Weight: NOT_IN_SBL_XBL_SPAMHAUS=-1.5 CL_IP_EQ_HELO_IP=-2 (check from: .googlemail. - helo: .mail-ed1-x52d.google. - helo-domain: .google.) FROM/MX_MATCHES_HELO(DOMAIN)=-2; rate: -5.5 X-Gm-Message-State: AFqh2kpe3KD53exLs88LcaxQ79oKBwQwkkjwvQAVLPxbQ4oRPiECvBrH tl63fCZhd/W6PA66aMzYPRbrYG1pX9WR2w== X-Google-SMTP-Source: AMrXdXu6DOVP1aOHlv6bZAXD0+Qk/xfUZNeAR1Zw1PQ5ZYHuy3LVutEa4m+EixDIPBcQxRRB1sCx9A== X-Received: by 2002:a05:6402:4487:b0:49a:1676:4287 with SMTP id er7-20020a056402448700b0049a16764287mr12467922edb.0.1674993141791; Sun, 29 Jan 2023 03:52:21 -0800 (PST) X-Google-Original-From: Malik Mlitat MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.4.2 Content-Language: en-US Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 7bit X-Mailing-List: archive/latest/20754 List-ID: List-URL: List-Archive: https://lists.debian.org/msgid-search/7c2f5e96-4a39-2747-e3a6-303c97f80979@gmail.com Approved: robomod@news.nic.it Lines: 74 Organization: linux.* mail to news gateway Sender: robomod@news.nic.it X-Original-Cc: 974502@bugs.debian.org X-Original-Date: Sun, 29 Jan 2023 12:52:20 +0100 X-Original-Message-ID: <7c2f5e96-4a39-2747-e3a6-303c97f80979@gmail.com> X-Original-References: <202011111802.0ABI2BcC006527@debian.vm> <202011111802.0ABI2BcC006527@debian.vm> Xref: csiph.com linux.debian.maint.python:14870 linux.debian.bugs.dist:1135348 Hello DPTeam, I updated python3-openid [1] to close #974502 and I need a maintainer to upload it. [1] https://salsa.debian.org/python-team/packages/python3-openid Regards, Malik On Wed, 11 Nov 2020 10:05:54 -0800 (PST) Sudip Mukherjee wrote: > Source: python3-openid > X-Debbugs-CC: elbrus@debian.org > Severity: important > Usertags: superficialtest > > Dear Maintainer, > > It has been noticed that the autopkgtest in python3-openid is running a > trivial command that does not provide significant test coverage: > > - python3 -c "import openid; print(openid)" > > Executing that command is considered to be a trivial test, which > does not provide significant coverage for a package as a whole. > But these tests are a useful way to detect regressions in dependencies > and prevent them from breaking your package. > > However, it is important that we are realistic about the level of > test coverage provided by these commands: most regressions cannot be > detected in this way. So it is not appropriate for packages with only > superficial tests to have the reduced migration time to migrate from > unstable to testing as that means less opportunity for testing by users > compared to the package with no tests. > > To support this, the keyword "Restrictions: superficial" has been > defined [1]. Packages where all tests are marked with this keyword are not > considered for the reduced migration age from unstable to testing, and > will not be allowed to migrate automatically in later stages of the > freeze [2]. > > Its always better to have more extensive testing than having > superficial testing, which again is better than having no test. > > Please consider i) Adding a non-trivial test, and/or ii) Mark the > trivial test with "Restrictions: superficial", similar to > [3] or [4]. > > The Release Team has listed this issue in the list of Release Critical > Issues for bullseye [5] and has mentioned that the test must be marked > superficial if it is not testing one of its own installed binary > packages in some way. As a result, the severity of this bug report might > be increased to serious in future. > > [1] https://salsa.debian.org/ci-team/autopkgtest/-/blob/master/doc/README.package-tests.rst#defined-restrictions > [2] https://release.debian.org/bullseye/freeze_policy.html > [3] https://salsa.debian.org/utopia-team/dbus/-/commit/a80908df7d119b181eec5eb0542634a30c2ad468 > [4] https://salsa.debian.org/apparmor-team/apparmor/-/commit/580667513a097088ebe579884b38ac8d8666d3b3 > [5] https://release.debian.org/bullseye/rc_policy.txt > > > -- > Regards > Sudip > >