Re: Large data sets

[Tony Plate <tplate@blackmesacapital.com>]

"Large" data set is all relative.  Some people might think 1Mb is large, 
but that's actually tiny by the standards of current machines.  I regularly 
use data objects in the region of 100Mb in S-plus under Windows 2000 on a 
machine with a couple of Gb of RAM.  I have no idea if that is "gigantic" 
or small for you.  (I'd think that a current reasonable interpretation of 
"gigantic" would be terabytes.)  On a Unix machine with more physical 
memory (and 64-bit addressing) you could work with proportionally larger 
data sets.  I think Insightful might be planning some more features in 
S-plus to perform analysis on data sets larger than will fit in S-plus -- 
you might want to check with them regarding features and timelines.
If you're planning to use ODBC you might want to verify that it will not be 
a bottleneck for your analysis.
hope this helps,

Tony Plate

At Tuesday 08:19 AM 4/27/2004, jose Bartolomei wrote:
> Hi S-users
>
> I am a student and I am quite new to R/S programming.  During my short 
> experience with the package and due to different comments (s-news & other) 
> I have the impression that S-Plus have problem dealing with very large 
> data sets.
> I am correct in having this notion?
>
> Soon I will receive a gigantic database that I was planned to analyze in 
> S-Plus.  To overcome this limitation I am planning to import the database to an
> SQL server and access the data via the S-Plus ODBC to conduct the analysis.
>
> This is a good idea?
>
> Thanks to all,
> jose
>
> _________________________________________________________________
> MSN Toolbar provides one-click access to Hotmail from any Web page ­ FREE 
> download! http://toolbar.msn.com/go/onm00200413ave/direct/01/
> --------------------------------------------------------------------
> This message was distributed by s-news@lists.biostat.wustl.edu.  To
> unsubscribe send e-mail to s-news-request@lists.biostat.wustl.edu with
> the BODY of the message:  unsubscribe s-news