Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
st: Missing (partial) records from ODBC load command
From
"Pi, Ron" <[email protected]>
To
"[email protected]" <[email protected]>
Subject
st: Missing (partial) records from ODBC load command
Date
Thu, 23 Feb 2012 13:12:36 -0800
Dear all,
I've been using the -odbc load- command as a routine to extract data from a network database for many years, from Stata/SE 8 to my the Stata/MP 11 (running on Window 7, 64 bit). When it runs smoothly, as has been the case until recently, the process takes about 15 minutes to extract roughly 4 million records. Below is the command in a do-file that executes the extract.
odbc load if stat_year==2011, exec("SELECT COURT_ID, SUMMARY_STATISTIC, STAT_MONTH, STAT_YEAR, ROW_ORDER") dsn("jbsis ") dialog(complete) user(ron) password(pi) lower
Recently the same command appears to extract the data with a big chunk of the records missing (about 10%), with no obvious pattern in the missing records. There were no warnings at the end of finishing the do-file. Memory does not appear to be the problem, as the extract file in Stata is less than 100 MB and the memory was set at 400 MB at the beginning of the process.
I wonder if anyone has had similar experiences, has any suggestions as to the source of the problem, or how to diagnose the problem?
Thanks,
Ron
======================================
Ron Pi
Supervising Research Analyst
Office of Court Research
Court Programs and Services Division
Judicial Council/Administrative Office of the Courts
455 Golden Gate Avenue
San Francisco, CA 94102-3688
415-865-7652 Fax 415-865-4586, [email protected]
www.courts.ca.gov
"Serving the courts for the benefit of all Californians."
*
* For searches and help try:
* http://www.stata.com/help.cgi?search
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/