I also have large datasets (1.5-2.0 million records), and I found a weird
solution. SPSS had no problems opening my datasets. If you then save them
as SPSS *.sav files, S-PLUS was able to import these no problem, even
though it would choke on the original raw data.
Hope you have access to SPSS :)
Stephen
At 01:10 PM 25/09/2003 -0500, John E. Cornell, Ph.D. wrote:
I have a dataset with 1.6 million records and 45 binary variables. I want
to apply monothetic (mona) and fuzzy (fanny) clustering methods to the
datamatrix. The original dataset was created in SAS, but I created a comma
delimited text version to import into S-Plus. When I try to import the
dataset via the Import GUI interface, the program freezes and stops
responding. Is there a more efficient way to import a large dataset into
S-Plus or R?
John Cornell
****************************************************************************
********
Expectation, hope, intention toward possibility that has still not become:
this is not only a basic feature of human consciousness, but, ..., a basic
determination within objective reality as a whole.
--Ernst Bloch
--The Principle of Hope (Vol. 1)
--------------------------------------------------------------------
This message was distributed by s-news@lists.biostat.wustl.edu. To
unsubscribe send e-mail to s-news-request@lists.biostat.wustl.edu with
the BODY of the message: unsubscribe s-news
|