Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
RE: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?
From
Alex Eapen <[email protected]>
To
"[email protected]" <[email protected]>
Subject
RE: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?
Date
Thu, 20 Jan 2011 22:44:53 +1100
Thanks for the further explanation and links, Neil. I intended to say in my earlier reply that the commands in each of my do-files are -summarize- and -regress-. These commands, according to the Stata/MP performance report, run faster on multiple cores. So my individual do-files will indeed run faster in Stata/MP and, as you say, the entire exercise should be faster compared to Stata/SE. I understand your point that what might make batch jobs run faster in general is better hardware (i.e., more memory or a faster CPU which makes available more resources to the concurrent do-files) than an upgrade to Stata/MP.
Alex
________________________________________
From: [email protected] [[email protected]] On Behalf Of Neil Shephard [[email protected]]
Sent: Thursday, 20 January 2011 9:51 PM
To: [email protected]
Subject: Re: st: RE: Will Stata/MP speed up running multiple dofiles inbatch mode?
On Thu, Jan 20, 2011 at 10:25 AM, Alex Eapen <[email protected]> wrote:
> Thanks Neil. That clarifies it for me. The commands I intend to run in each dofile are -summ- and -regress-. So by your reasoning I will see improvements when I upgrade to Stata/MP.
Hmm, thats not really what I was trying to convey. I don't have a
version of Stata/MP to test this with, but in my opinion because you
will be starting multiple instances of Stata/MP (one to run each batch
file) you are unlikely to see any great improvement in the speed at
which they all complete because how can one instance know that another
instance is already running and take advantage of the hyperthreading
that is used to spread jobs across the multiple cores of your CPU?
Its one instance of Stata/MP that takes advantage of the multiple
cores in your CPU because its be re-written to use hyper-threading.
You'll see an improvement if, and only if, running bigjob1.do runs
faster under Stata/MP than it does under Stata/SE because _each_ batch
job will complete faster (see the official Stata report I linked for
details and quantification of this).
Perhaps some background on multi-core processors and hyper-threading
would be informative
http://en.wikipedia.org/wiki/Multi-core_%28computing%29 and
http://en.wikipedia.org/wiki/Hyper-threading would make good.
Neil
--
“Truth in science can be defined as the working hypothesis best suited
to open the way to the next better one.” - Konrad Lorenz
Email - [email protected]
Website - http://kimura.no-ip.org/
Photos - http://www.flickr.com/photos/slackline/
*
* For searches and help try:
* http://www.stata.com/help.cgi?search
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/
*
* For searches and help try:
* http://www.stata.com/help.cgi?search
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/