Dear all,
I have a very large dataset in CSV format with 486,000 KB. The data
contains more than 100 fields and more than 300,000 recodes. I have
tried to open this file by set mem 500M (or 1000M) and used
insheet using filename.csv, clear
The error message shows that there is no enough memory to load the data.
Could anyone suggest me on the followings?
1) How to read only several fields from this CSV data file, say the
first, thirteenth and thirtieth?
2) What command should I try to load the whole data?
Many thanks,
Haiyan
-----Original Message-----
From: [email protected]
[mailto:[email protected]] On Behalf Of Nick Cox
Sent: 19 January 2009 21:47
To: [email protected]
Subject: st: -iquantile- available on SSC
Thanks to Kit Baum, a new package -iquantile- is now available from SSC.
This was discussed yesterday in my post
<http://www.hsph.harvard.edu/cgi-bin/lwgate/STATALIST/archives/statalist
.0901/date/article-689.html>
in a thread on fractional medians. I changed the problem, and the name,
but had fun. A capsule description follows my signature. The help file
is quite detailed with much commentary. Use -ssc inst iquantile- to
install if interested.
Nick
[email protected]
iquantile Stata module to calculate interpolated quantiles
iquantile calculates and displays quantiles estimated by linear
interpolation in the mid-distribution function. The user may specify one
or more numeric variables, one or more grouping variables and one or
more quantiles.
Author
Nicholas J. Cox, Durham University, UK
[email protected]
Stata 9 required
Keywords: quantiles, order statistics, median, quartiles
*
* For searches and help try:
* http://www.stata.com/help.cgi?search
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/
------------------------------------------------------------------------
This email is confidential and is intended solely for the person or
Entity to whom it is addressed. If this is not you, please forward the
Message to [email protected]. We have scanned this email
before sending it, but cannot guarantee that malicious software is
absent and we shall carry no liability in this regard.
We advise that information intended to be kept confidential should not
Be sent by email. We also advise that health concerns should be
Discussed with a medical professional in person or by telephone.
NHS Direct can also provide advice. We shall not be liable for any
failure to follow this advice. University College London Hospitals NHS
Foundation Trust (UCLH).
*
* For searches and help try:
* http://www.stata.com/help.cgi?search
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/