Groups > linux.debian.maint.python > #9855

Re: Python 3 Statsmodels & Pandas

From	Andreas Tille <andreas@fam-tille.de>
Newsgroups	linux.debian.maint.python
Subject	Re: Python 3 Statsmodels & Pandas
Date	2017-09-26 09:20 +0200
Message-ID	<utSjV-1vB-13@gated-at.bofh.it> (permalink)
References	(5 earlier) <usoxz-29n-3@gated-at.bofh.it> <utjPb-3Dt-5@gated-at.bofh.it> <utvnj-2Gs-3@gated-at.bofh.it> <utwjn-3iD-9@gated-at.bofh.it> <utPP3-8be-3@gated-at.bofh.it>
Organization	linux.* mail to news gateway

Show all headers | View raw

On Mon, Sep 25, 2017 at 09:36:43PM -0700, Diane Trout wrote:
> > > * Some of the doc pages call get_rdataset, and there's no network
> > > access in the builder so those calls fail. (ugliest error)
> > 
> > Can you pre-fetch the data and provide it in debian/datasets?
> 
> I made the changes and cached the downloaded zip files....
> 
> and then realized isn't this redistributing datasets?
> 
> Don't we need to verify the license before uploading?

In principle yes.
 
> Below is what I've found so far, (before getting tired of licensing
> issues)
> 
> Any thoughts about how to handle this?

I wonder how this was dealt with before?  If that much data sets were
needed to build the docs, how did the doc generation process worked
before?

My thought is that we should shift anything to a later point of
development which would cause a delay in fixing all RC bugs -
specifically #873512 remains open.  I have pinged upstream about this.
If we migrate to ship also python3, we need extra cycles through new and
may be new bugs to fix.

BTW, I'd love if you would merge your work to master branch.  I'm a bit
confused by the amount of branches and lost track which one to look at.
 
> Here's a list of the file names from the include-binaries file I
> created via caching.
> 
> datasets.csv.zip                    
> csv,HistData,Guerry.csv.zip         
> doc,HistData,rst,Guerry.rst.zip     
> csv,COUNT,medpar.csv.zip            
> doc,COUNT,rst,medpar.rst.zip        
> csv,car,Duncan.csv.zip              
> doc,car,rst,Duncan.rst.zip          
> csv,robustbase,starsCYG.csv.zip     
> doc,robustbase,rst,starsCYG.rst.zip 
> doc,car,rst,Moore.rst.zip           
> csv,vcd,Arthritis.csv.zip           
> doc,vcd,rst,Arthritis.rst.zip       
> csv,MASS,epil.csv.zip               
> doc,MASS,rst,epil.rst.zip           
> csv,geepack,dietox.csv.zip          
> doc,geepack,rst,dietox.rst.zip      
> 
> The files are being downloaded from this github repository.
> 
> https://github.com/vincentarelbundock/Rdatasets a useful index of the
> datasets is 
> http://vincentarelbundock.github.com/Rdatasets/datasets.html

This reminds me to the debian/README.source files ftpmaster once
suggested for R packages[1].  May be that's an apropriate way to
document the licenses?  Feel free to find examples for instance
in the package r-cran-ape.
 
> Guerry.csv is probably safe as its from "Essay on the Moral Statistics
> of France" published 1833.
> 
> medpar 2016's license is here:
> https://www.healthdata.gov/dataset/medpar-limited-data-set-lds-hospital
> -national
> and is listed as "Open Data Commons Open Database License"
> https://opendatacommons.org/licenses/odbl/1.0/
> 
> Duncan is the Duncan's Occupational Prestige Data from 1950.
> Couldn't find a license
> 
> starsCYG is Data for the Hertzsprung-Russell Diagram of the star
> cluster CYG OB1
> http://ugrad.stat.ubc.ca/R/library/rrcov/html/stars.html
> Couldn't find a license
> 
> Moore is from Moore, J. C., Jr. and Krupat, E. (1971) 
> Relationship between source status, authoritarianism and conformity in
> a social setting.
> Couldn't find a license

So may be we should patch the docs to ignore those data sets without a
license.

Thanks a lot for your work on this package

    Andreas.


[1] http://lists.debian.org/debian-devel/2013/09/msg00332.html 

-- 
http://fam-tille.de

Thread

Bug#729956: Forwarded upstream Andreas Tille <tille@debian.org> - 2017-09-06 22:30 +0200
  Bug#729956: Forwarded upstream Yuri D'Elia <wavexx@thregr.org> - 2017-09-06 22:40 +0200
    Bug#729956: Forwarded upstream Andreas Tille <tille@debian.org> - 2017-09-06 23:00 +0200
      Bug#729956: git-dpm (was Re: Bug#729956: Forwarded upstream) Yuri D'Elia <wavexx@thregr.org> - 2017-09-06 23:20 +0200
        Re: git-dpm (was Re: Bug#729956: Forwarded upstream) Scott Kitterman <debian@kitterman.com> - 2017-09-07 00:50 +0200
          Re: git-dpm (was Re: Bug#729956: Forwarded upstream) Brian May <brian@linuxpenguins.xyz> - 2017-09-07 01:20 +0200
            Re: git-dpm (was Re: Bug#729956: Forwarded upstream) Yuri D'Elia <wavexx@thregr.org> - 2017-09-08 00:50 +0200
          Re: git-dpm (was Re: Bug#729956: Forwarded upstream) Brian May <brian@linuxpenguins.xyz> - 2017-09-07 01:30 +0200
            Re: git-dpm (was Re: Bug#729956: Forwarded upstream) Scott Kitterman <debian@kitterman.com> - 2017-09-07 07:00 +0200
              Re: git-dpm (was Re: Bug#729956: Forwarded upstream) Brian May <brian@linuxpenguins.xyz> - 2017-09-07 07:30 +0200
  Bug#729956: Forwarded upstream Diane Trout <diane@ghic.org> - 2017-09-07 00:30 +0200
    Bug#729956: Forwarded upstream Matthias Klose <doko@debian.org> - 2017-09-07 06:20 +0200
    Bug#729956: Forwarded upstream Andreas Tille <andreas@an3as.eu> - 2017-09-07 06:30 +0200
      Bug#729956: Forwarded upstream Diane Trout <diane@ghic.org> - 2017-09-07 06:40 +0200
        Bug#729956: Forwarded upstream Andreas Tille <andreas@an3as.eu> - 2017-09-07 08:40 +0200
          Bug#729956: Forwarded upstream Diane Trout <diane@ghic.org> - 2017-09-08 08:40 +0200
  Bug#729956: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-16 22:50 +0200
    Bug#729956: Python 3 Statsmodels & Pandas Yuri D'Elia <wavexx@thregr.org> - 2017-09-16 23:10 +0200
      Bug#729956: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-16 23:30 +0200
        Bug#729956: Python 3 Statsmodels & Pandas Yuri D'Elia <wavexx@thregr.org> - 2017-09-17 00:00 +0200
          Re: skimage (was: Re: Bug#729956: Python 3 Statsmodels & Pandas) Yaroslav Halchenko <yoh@debian.org> - 2017-10-13 00:10 +0200
          skimage (was: Re: Bug#729956: Python 3 Statsmodels & Pandas) Yuri D'Elia <wavexx@thregr.org> - 2017-10-13 00:40 +0200
        Re: Python 3 Statsmodels & Pandas Stuart Prescott <stuart@debian.org> - 2017-09-18 04:00 +0200
          Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-18 07:20 +0200
            Re: Python 3 Statsmodels & Pandas Stuart Prescott <stuart@debian.org> - 2017-09-18 10:10 +0200
              Re: Python 3 Statsmodels & Pandas Gordon Ball <gordon@chronitis.net> - 2017-09-18 19:30 +0200
                Re: Python 3 Statsmodels & Pandas Matthias Klose <doko@debian.org> - 2017-09-18 21:30 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-19 06:50 +0200
              Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@an3as.eu> - 2017-09-21 16:30 +0200
                Re: Python 3 Statsmodels & Pandas Ghislain Vaillant <ghisvail@gmail.com> - 2017-09-21 17:00 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-21 23:50 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-22 00:10 +0200
                Re: Python 3 Statsmodels & Pandas Yaroslav Halchenko <debian@onerussian.com> - 2017-09-22 04:30 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-22 07:20 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-24 20:30 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@fam-tille.de> - 2017-09-25 00:10 +0200
                Re: Python 3 Statsmodels & Pandas Yaroslav Halchenko <debian@onerussian.com> - 2017-09-25 01:00 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-25 01:20 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-25 08:50 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@an3as.eu> - 2017-09-25 09:50 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-25 19:40 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@an3as.eu> - 2017-09-25 19:50 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-26 06:40 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@fam-tille.de> - 2017-09-26 09:20 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-26 20:40 +0200
                Re: Python 3 Statsmodels & Pandas Yaroslav Halchenko <debian@onerussian.com> - 2017-09-26 22:50 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@an3as.eu> - 2017-09-26 23:00 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-26 23:50 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@fam-tille.de> - 2017-09-27 08:20 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-27 07:50 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@fam-tille.de> - 2017-09-27 09:00 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-27 09:30 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@an3as.eu> - 2017-09-27 10:10 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@an3as.eu> - 2017-09-27 12:20 +0200
                Re: Python 3 Statsmodels & Pandas "Rebecca N. Palmer" <rebecca_palmer@zoho.com> - 2017-09-29 23:40 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-30 01:00 +0200
                Re: Python 3 Statsmodels & Pandas "Rebecca N. Palmer" <rebecca_palmer@zoho.com> - 2017-09-30 10:20 +0200
                Re: Python 3 Statsmodels & Pandas Ghislain Vaillant <ghisvail@gmail.com> - 2017-09-30 11:20 +0200
                Re: Python 3 Statsmodels & Pandas Dmitry Shachnev <mitya57@debian.org> - 2017-09-30 11:30 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-30 18:00 +0200
                Re: Python 3 Statsmodels & Pandas "Rebecca N. Palmer" <rebecca_palmer@zoho.com> - 2017-09-30 18:40 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@an3as.eu> - 2017-09-22 08:20 +0200
                Re: Python 3 Statsmodels & Pandas Yaroslav Halchenko <debian@onerussian.com> - 2017-09-23 16:10 +0200
                Re: Python 3 Statsmodels & Pandas Andreas Tille <andreas@an3as.eu> - 2017-09-24 13:30 +0200
                Re: Python 3 Statsmodels & Pandas Yaroslav Halchenko <debian@onerussian.com> - 2017-09-25 01:00 +0200
                Re: Python 3 Statsmodels & Pandas Yaroslav Halchenko <yoh@onerussian.com> - 2017-09-22 00:20 +0200
                Re: Python 3 Statsmodels & Pandas Piotr Ożarowski <piotr@debian.org> - 2017-09-22 11:00 +0200
                Re: Python 3 Statsmodels & Pandas Diane Trout <diane@ghic.org> - 2017-09-22 21:40 +0200
                Re: Python 3 Statsmodels & Pandas Ghislain Vaillant <ghisvail@gmail.com> - 2017-09-23 11:50 +0200
                Re: Python 3 Statsmodels & Pandas Yaroslav Halchenko <debian@onerussian.com> - 2017-09-23 16:00 +0200
                Re: Python 3 Statsmodels & Pandas Piotr Ożarowski <piotr@debian.org> - 2017-09-25 11:20 +0200
      Bug#729956: Python 3 Statsmodels & Pandas Matthias Klose <doko@debian.org> - 2017-09-17 11:20 +0200

csiph-web