Re: If Debian support OS certification?

From	Paul Wise <pabs@debian.org>
Newsgroups	linux.debian.project
Subject	Re: If Debian support OS certification?
Date	2017-05-03 11:00 +0200
Message-ID	<tCYiB-2Mi-11@gated-at.bofh.it> (permalink)
References	<tkKQN-1VS-5@gated-at.bofh.it> <tkM6d-340-3@gated-at.bofh.it> <tCqTD-5JW-5@gated-at.bofh.it> <tCu1b-7zX-1@gated-at.bofh.it> <tCKfD-1nA-13@gated-at.bofh.it>
Organization	Debian

Show all headers | View raw

[Multipart message — attachments visible in raw view] - view raw

On Tue, 2017-05-02 at 23:29 +0530, Ritesh Raj Sarraf wrote:

> As members, we should come up with a "Certification Policy" guide. Which should
> define what constitutes a particular machine being marked certified. Then a
> testsuite could be built accordingly.

Sounds good to me, would you mind starting a wiki page for this?

> It will have to go beyond the "does boot" scope, in my opinion.

Clearly, since each bit of hardware in each particular situation has a
probably unique set of features that need testing in their own way.
For example if there is a USB missile launcher attached, it should
definitely use isenkram install pymissile and ask the user to run the
tests for that.

> Like most other Enterprise Linux Distributions, Debian too picks a
> particular kernel (stable- lts) and to some extent also backports
> fixes into it. That makes it a completely unique kernel, against
> which certification needs to be done.

It is true that we use a unique version of Linux/kFreeBSD/Hurd but I
would advocate a different approach. There is a lot of hardware that
will never run mainline Linux and will never be able to be fully
supported by Debian. These systems should be able to be certified to
work with Debian but the certification would make it clear which
version of each component was used, including those that were not from
Debian. For example ARM systems will be able to have OpenGL but only
with the proprietary binary drivers. Other systems will be able to run
one release of Debian but not another (for example my MIPS router can
run jessie but not stretch because the CPU requirements changed).

> In all the certification tools I've worked with, rigorous stress
> tests are the most important part. For example, for file systems,
> doing large amounts of I/O with different chunks; Buffered and Direct
> I/O etc. Single queue, multi queue. WRITE_SAME and TRIM related HW
> Commands. CPU Burn, Memory tests, Network etc.

That sounds like a description of anarcat's stressant project.

https://gitlab.com/anarcat/stressant

> All core components of a server hardware needs tests to certify any
> server hardware.

I would strongly suggest *not* limiting this project to servers.
There are at least various types of cloud providers, laptops, desktops,
SBCs, routers, TVs etc that Debian can probably run on in some way.

> Yes. But I think we need to provide a tool, process and guideline for them to
> follow. So far, from what I've checked, not much engagement has been initiated
> from the hardware vendors.

I think instead of a tool, we want a framework for packages available
in Debian to provide both automatic and manual instructions for testing
things outside of the Debian system. Then we want a setup that can run
the automatic tests and provide the manual instructions to the user.
The process would then be: boot ISO, wait for auto tests, do manual
tests and enter results, click submit, take photo of certification and
or save any digital artefacts of the certification to external media.

-- 
bye,
pabs

https://wiki.debian.org/PaulWise

Thread

If Debian support OS certification? Eric Lai (賴裕文) <Eric_Lai@quantatw.com> - 2017-03-14 04:00 +0100
  Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-03-14 05:20 +0100
    Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-03-15 01:40 +0100
      RE: If Debian support OS certification? Eric Lai (賴裕文) <Eric_Lai@quantatw.com> - 2017-03-15 09:40 +0100
      Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-03-17 01:40 +0100
    Re: If Debian support OS certification? Thomas Goirand <zigo@debian.org> - 2017-05-01 23:20 +0200
      Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-02 02:40 +0200
        Re: If Debian support OS certification? Luca Filipozzi <lfilipoz@debian.org> - 2017-05-02 03:10 +0200
        Re: If Debian support OS certification? Ritesh Raj Sarraf <rrs@debian.org> - 2017-05-02 20:00 +0200
          Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-03 11:00 +0200
            Re: If Debian support OS certification? Ben Hutchings <ben@decadent.org.uk> - 2017-05-03 18:20 +0200
              Re: If Debian support OS certification? "Andre Felipe Machado" <andremachado@techforce.com.br> - 2017-05-03 21:30 +0200
              Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-04 02:00 +0200
                Re: If Debian support OS certification? Steve McIntyre <steve@einval.com> - 2017-05-04 02:10 +0200
                Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-04 03:20 +0200
                Re: If Debian support OS certification? Ben Hutchings <ben@decadent.org.uk> - 2017-05-04 02:30 +0200
                Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-04 03:30 +0200
                Re: If Debian support OS certification? Thomas Goirand <zigo@debian.org> - 2017-05-17 00:40 +0200
                Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-17 03:10 +0200
                Re: If Debian support OS certification? Ian Jackson <ijackson@chiark.greenend.org.uk> - 2017-05-17 15:40 +0200
                Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-17 16:00 +0200
                Re: If Debian support OS certification? Holger Levsen <holger@layer-acht.org> - 2017-05-17 16:00 +0200
                Re: If Debian support OS certification? Zlatan Todoric <zlatan@riseup.net> - 2017-05-18 11:30 +0200
          Re: If Debian support OS certification? Ritesh Raj Sarraf <rrs@debian.org> - 2017-05-16 08:20 +0200
            Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-16 10:20 +0200
        Re: If Debian support OS certification? Thomas Goirand <zigo@debian.org> - 2017-05-04 18:30 +0200
        Re: If Debian support OS certification? Thomas Goirand <zigo@debian.org> - 2017-05-05 17:00 +0200
          Re: If Debian support OS certification? Ben Hutchings <ben@decadent.org.uk> - 2017-05-05 23:50 +0200
            Re: If Debian support OS certification? Luca Filipozzi <lfilipoz@debian.org> - 2017-05-06 04:00 +0200
              Re: If Debian support OS certification? Thomas Goirand <zigo@debian.org> - 2017-05-16 18:20 +0200
                Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-17 02:20 +0200
                Re: If Debian support OS certification? Ian Jackson <ijackson@chiark.greenend.org.uk> - 2017-05-17 15:30 +0200
                Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-17 16:00 +0200
                Re: If Debian support OS certification? Thomas Goirand <zigo@debian.org> - 2017-05-19 17:50 +0200
                Re: If Debian support OS certification? Paul Wise <pabs@debian.org> - 2017-05-20 03:40 +0200
          Re: If Debian support OS certification? Tollef Fog Heen <tfheen@err.no> - 2017-05-06 09:40 +0200

csiph-web