s-news
[Top] [All Lists]

Re: Large data sets

To: "'Tony Plate'" <tplate@blackmesacapital.com>, "'jose Bartolomei'" <surfprjab@hotmail.com>, <s-news@lists.biostat.wustl.edu>
Subject: Re: Large data sets
From: "Eric Zivot" <ezivot@u.washington.edu>
Date: Tue, 27 Apr 2004 11:33:21 -0700
In-reply-to: <6.1.0.6.2.20040427111902.03876e38@mailhost.blackmesacapital.com>
Thread-index: AcQsfaQqtBbZjkQGQlGoQVegBHN7RwACEonQ
I believe that Splus 6.2 has a native interface to SQL server so that S-PLUS
ODBC is no longer required.  

-----Original Message-----
From: s-news-owner@lists.biostat.wustl.edu
[mailto:s-news-owner@lists.biostat.wustl.edu] On Behalf Of Tony Plate
Sent: Tuesday, April 27, 2004 10:27 AM
To: jose Bartolomei; s-news@lists.biostat.wustl.edu
Subject: Re: [S] Large data sets

"Large" data set is all relative.  Some people might think 1Mb is large, but
that's actually tiny by the standards of current machines.  I regularly use
data objects in the region of 100Mb in S-plus under Windows 2000 on a
machine with a couple of Gb of RAM.  I have no idea if that is "gigantic" 
or small for you.  (I'd think that a current reasonable interpretation of
"gigantic" would be terabytes.)  On a Unix machine with more physical memory
(and 64-bit addressing) you could work with proportionally larger data sets.
I think Insightful might be planning some more features in S-plus to perform
analysis on data sets larger than will fit in S-plus -- you might want to
check with them regarding features and timelines.

If you're planning to use ODBC you might want to verify that it will not be
a bottleneck for your analysis.

hope this helps,

Tony Plate

At Tuesday 08:19 AM 4/27/2004, jose Bartolomei wrote:
>Hi S-users
>
>I am a student and I am quite new to R/S programming.  During my short 
>experience with the package and due to different comments (s-news & 
>other) I have the impression that S-Plus have problem dealing with very 
>large data sets.
>
>I am correct in having this notion?
>
>Soon I will receive a gigantic database that I was planned to analyze 
>in S-Plus.  To overcome this limitation I am planning to import the 
>database to an SQL server and access the data via the S-Plus ODBC to
conduct the analysis.
>
>This is a good idea?
>
>Thanks to all,
>jose
>
>_________________________________________________________________
>MSN Toolbar provides one-click access to Hotmail from any Web page - 
>FREE download! http://toolbar.msn.com/go/onm00200413ave/direct/01/
>
>--------------------------------------------------------------------
>This message was distributed by s-news@lists.biostat.wustl.edu.  To 
>unsubscribe send e-mail to s-news-request@lists.biostat.wustl.edu with 
>the BODY of the message:  unsubscribe s-news

--------------------------------------------------------------------
This message was distributed by s-news@lists.biostat.wustl.edu.  To
unsubscribe send e-mail to s-news-request@lists.biostat.wustl.edu with the
BODY of the message:  unsubscribe s-news


<Prev in Thread] Current Thread [Next in Thread>