RE: st: hunting for the source of an error - r(603) - Dual Core problem?

["Ben Hoen" <bhoen@lbl.gov>]

Thank you David, William, Jeph, Michael & Klaus!

As expected, your insights are spot on.  

Using this link:
http://www.stata.com/support/faqs/data-management/moving-temporary-directory
/
and this one:
http://www.stata.com/support/faqs/data-management/statatmp-environment-varia
ble/

I was able to change the location of the temp folder, and separately I was
able to add that folder as an exception to my virus protection software.  

The code then ran flawlessly (and only took ~ 2.5 hours vs. the 8 hours I
expected it would take).  

Seems like a win-win.  

Best wishes for the new year, and thank you for all the help.

Ben

On Thu, Dec 27, 2012 at 9:46 AM, William Buchanan
<william@williambuchanan.net> wrote:
Hi Ben,

How large is the file you're working from? How large are the temp files
you're creating? Do you have many other processes working in the background?
Although I've never encountered the problem I think your intuition about it
being some kind of resource issue might have some merit.

In the meantime, it might be helpful to be more explicit about what you are
hoping to accomplish in the end. Typically, looping over individual
observations is not a great idea, although there are certainly times when it
is a necessary evil.  Maybe with more details about what you are trying to
do other could provide you with suggestions that could make that process
more efficient and avoid creating > 100,000 tempfiles.

HTH,
Billy

Sent from my iPhone

On Dec 27, 2012, at 6:43, "Ben Hoen" <bhoen@lbl.gov> wrote:

> Hi all,
>
> I have a relatively simple looping function that repeatedly saves and
calls
> up temp files while looping through each case in a dataset, which, if
> successful, should take ~ 8 hours to run, though, I have yet to have it
> execute properly.  The last four times I have tried to run it will the
full
> sample I have gotten the same error:
>
> "file C:\Users\Ben\AppData\Local\Temp\ST_0500000x.tmp could not be opened
> r(603);
>
> end of do-file
>
> r(603);"
>
> where x=3, 4 or 6
>
> Each time the error has happened on a different case.  The most recent
three
> occurred on the 794th, 25,835th and the 20,633rd  cases (and before that I
> had runs out to the 70,000 and 60,000th (or so) cases.  There are a total
of
> 166,181 cases.
>
> Is it something outside my code that is likely making this occur?  I am
> wondering if this has something to do with a dual-core processor.  I am
> running Windows 7- 64bit, with an Intel Duo Core E8600 - 3.33 Ghz
processor
> with 8 GB of RAM, and am running Stata MP 12.1 for Windows - 64bit.  BUT,
> that is a GUESS (and nothing more).  My thought was that this error is
> occurring when the file is in use or is stored in one processor while the
> other is trying to access it?
>
> I have tried to force the error by running the code using many different
> subsamples and have never been able to get it to crash, and unfortunately
> breaking the sample down into smaller sample somewhat defeats the purpose
of
> the code in the first place (which is creating nearest neighbor weights -
> using, in part, geonear(SSC)).  It seems important that the error has
> occurred on a different case, potentially indicating that the problem is
not
> with the sample.
>
> Any ideas?  Thank you in advance for any assistance/advice you can offer.
>
> Ben
>
> Ben Hoen
> Principal Research Associate
> Lawrence Berkeley National Laboratory
> Office: 845-758-1896
> Cell: 718-812-7589
> bhoen@lbl.gov
> http://emp.lbl.gov/staff/ben-hoen
>
> Visit our publications at:
> http://emp.lbl.gov/publications
>
>
>
>
>
> *
> *   For searches and help try:
> *   http://www.stata.com/help.cgi?search
> *   http://www.stata.com/support/faqs/resources/statalist-faq/
> *   http://www.ats.ucla.edu/stat/stata/

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/faqs/resources/statalist-faq/
*   http://www.ats.ucla.edu/stat/stata/



-- 
LBNL
phone: 845-758-1896
cell: 718-812-7589
bhoen@lbl.gov


*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/faqs/resources/statalist-faq/
*   http://www.ats.ucla.edu/stat/stata/