Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
Re: st: Missing (partial) records from ODBC load command
From
"Dimitriy V. Masterov" <[email protected]>
To
[email protected]
Subject
Re: st: Missing (partial) records from ODBC load command
Date
Thu, 23 Feb 2012 16:41:16 -0500
Ron,
Here's a couple of things to try while waiting for tech support. I've
often found this approach useful when I get puzzling database/Stata
experiences:
What happens if you restrict the year in the SQL command rather than
the if clause?
Alternatively, what happens if you were to replicate the same command
without the select part? That is, load the variables you want from the
table rather the table generated by the select statement.
DVM
On Thu, Feb 23, 2012 at 4:25 PM, Austin Nichols <[email protected]> wrote:
> Ron Pi <[email protected]>:
> I hope that's not your real password you just posted on the internet.
> May I suggest 314159265 instead?
>
> You may want to contact Stata tech support directly on this one.
>
> On Thu, Feb 23, 2012 at 4:12 PM, Pi, Ron <[email protected]> wrote:
>> Dear all,
>>
>> I've been using the -odbc load- command as a routine to extract data from a network database for many years, from Stata/SE 8 to my the Stata/MP 11 (running on Window 7, 64 bit). When it runs smoothly, as has been the case until recently, the process takes about 15 minutes to extract roughly 4 million records. Below is the command in a do-file that executes the extract.
>>
>> odbc load if stat_year==2011, exec("SELECT COURT_ID, SUMMARY_STATISTIC, STAT_MONTH, STAT_YEAR, ROW_ORDER") dsn("jbsis ") dialog(complete) user(ron) password(pi) lower
>>
>> Recently the same command appears to extract the data with a big chunk of the records missing (about 10%), with no obvious pattern in the missing records. There were no warnings at the end of finishing the do-file. Memory does not appear to be the problem, as the extract file in Stata is less than 100 MB and the memory was set at 400 MB at the beginning of the process.
>>
>> I wonder if anyone has had similar experiences, has any suggestions as to the source of the problem, or how to diagnose the problem?
>>
>> Thanks,
>> Ron
>
> *
> * For searches and help try:
> * http://www.stata.com/help.cgi?search
> * http://www.stata.com/support/statalist/faq
> * http://www.ats.ucla.edu/stat/stata/
*
* For searches and help try:
* http://www.stata.com/help.cgi?search
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/