Path: csiph.com!v102.xanadu-bbs.net!xanadu-bbs.net!feeder.erje.net!eu.feeder.erje.net!newsfeed.xs4all.nl!newsfeed3a.news.xs4all.nl!xs4all!post.news.xs4all.nl!not-for-mail Return-Path: X-Original-To: python-list@python.org Delivered-To: python-list@mail.python.org X-Spam-Status: OK 0.010 X-Spam-Evidence: '*H*': 0.98; '*S*': 0.00; 'subject:error': 0.03; 'variables': 0.07; 'python:': 0.09; 'received:67.192': 0.09; 'received:67.192.241': 0.09; 'received:dfw.emailsrvr.com': 0.09; 'statistical': 0.09; 'python': 0.11; 'question.': 0.14; 'correlation': 0.16; 'wrote:': 0.18; 'all,': 0.19; 'header:User- Agent:1': 0.23; 'received:emailsrvr.com': 0.24; 'question': 0.24; "i've": 0.25; 'received:(smtp server)': 0.26; 'header:In-Reply- To:1': 0.27; 'am,': 0.29; 'quickly': 0.29; "i'm": 0.30; 'gary': 0.31; 'sets.': 0.31; 'interface': 0.32; 'but': 0.35; 'really': 0.36; 'two': 0.37; 'to:addr:python-list': 0.38; 'files': 0.38; 'to:addr:python.org': 0.39; 'forum': 0.61; 'new': 0.61; 'more': 0.64; 'afraid': 0.65; 'between': 0.67; 'isolated': 0.84; 'significance': 0.84; 'skip:s 80': 0.84 X-Virus-Scanned: OK Date: Mon, 24 Mar 2014 13:37:23 -0700 From: Gary Herron User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.3.0 MIME-Version: 1.0 To: python-list@python.org Subject: Re: Memory error References: In-Reply-To: Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit X-BeenThere: python-list@python.org X-Mailman-Version: 2.1.15 Precedence: list List-Id: General discussion list for the Python programming language List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Newsgroups: comp.lang.python Message-ID: Lines: 28 NNTP-Posting-Host: 2001:888:2000:d::a6 X-Trace: 1395693999 news.xs4all.nl 2886 [2001:888:2000:d::a6]:53852 X-Complaints-To: abuse@xs4all.nl Xref: csiph.com comp.lang.python:68904 On 03/24/2014 04:32 AM, Jamie Mitchell wrote: > Hello all, > > I'm afraid I am new to all this so bear with me... > > I am looking to find the statistical significance between two large netCDF data sets. > > Firstly I've loaded the two files into python: > > swh=netCDF4.Dataset('/data/cr1/jmitchel/Q0/swh/controlperiod/averages/swh_control_concat.nc', 'r') > > swh_2050s=netCDF4.Dataset('/data/cr1/jmitchel/Q0/swh/2050s/averages/swh_2050s_concat.nc', 'r') > > I have then isolated the variables I want to perform the pearson correlation on: > > hs=swh.variables['hs'] > > hs_2050s=swh_2050s.variables['hs'] This is not really a Python question. It's a question about netCDF (whatever that may be), or perhaps it's interface to Python python-netCD4. You may get an answer here, but you are far more likely to get one quickly and accurately from a forum dedicated to netCDF, or python-netCD. Good luck. Gary Herron