Groups > comp.soft-sys.math.mathematica > #2243

Re: Import speed from different file types

From	"Hans Michel" <hmichel@cox.net>
Newsgroups	comp.soft-sys.math.mathematica
Subject	Re: Import speed from different file types
Date	2011-05-10 00:20 +0000
Organization	Steven M. Christensen and Associates, Inc and MathTensor, Inc.
Message-ID	<iqa0bp$d8g$1@smc.vnet.net> (permalink)

Show all headers | View raw

The advantages of storing data to a database should not be over looked.

In addition dbs such as MySQL, PostgreSQL, MS SQL, Sybase, and others have
API where with MathLink one can hook directly into the database either
through ODBC or other methods. At first it may seem like more to learn:
Mathematica, SQL, C, Mathlink; but it is worth it.

I doubt Wolfram|Alpha would be where it is without a database on the back
end [WebServer (code)<-> Mathematica (code, logic) <-> database (code,data,
logic)]
Hans

-----Original Message-----
From: Armand Tamzarian [mailto:mike.honeychurch@gmail.com] 
Sent: Monday, May 09, 2011 5:21 AM
Subject:  Re: Import speed from different file types

On May 5, 9:47 am, CPE Bach <hisi...@gmail.com> wrote:
> Hi users,
> So I have hundreds of data files of time series of stock returns. To make
the import process as fast as possible in Mathematica 8, should I prepare
those data files in what format?
>
> xls? csv? dat? txt?
>
> Thanks for your input in advance.
>
> MP
>

If you want to regularly analyze the data then your best bet is
definitely to get all of this data into a database and use the
DatabaseLink. Seriously you'll wonder why you ever bothered importing
Excel etc. files. Also in the future add your data directly into the
database.

Mike

Back to comp.soft-sys.math.mathematica | Previous | Next | Find similar | Unroll thread

Thread

Re: Import speed from different file types "Hans Michel" <hmichel@cox.net> - 2011-05-10 00:20 +0000

csiph-web