Statalist


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

AW: AW: AW: st: Increasing Stata Memory


From   "Martin Weiss" <[email protected]>
To   <[email protected]>
Subject   AW: AW: AW: st: Increasing Stata Memory
Date   Tue, 12 Jan 2010 15:18:58 +0100

<> 

"I haven't, loaded any data though"



It is straightforward to check, though, with the help of the calculator at http://www.stata.com/support/faqs/data/datacalc.cgi, which predicts " 5367 MB" for the dataset being constructed below. 


*************
clear*
set mem 6G
set obs 7000000
 
foreach var of newlist myvar1-myvar100{
	gen double `var'=rnormal(10000,100000)
}
 
d,s
*************

Stata 11 MP on Vista 64bit manages to construct the data in 108 seconds on my machine with 8G of RAM. The -describe- command yields:


Contains data
  obs:     7,000,000                          
 vars:           100                          
 size: 5,656,000,000 (12.6% of memory free)



With this fake dataset loaded, I can still -summarize- all 100 variables in 69 seconds, so there is still RAM for Stata to work with...

HTH
Martin


-----Ursprüngliche Nachricht-----
Von: [email protected] [mailto:[email protected]] Im Auftrag von Ulrich Kohler
Gesendet: Dienstag, 12. Januar 2010 14:28
An: [email protected]
Betreff: RE: AW: AW: st: Increasing Stata Memory

Hm, I always thought I can get even more memory than I physically have. 
I tried 

forval x = 3000(100)10000 {
	di "Trying to set memory to `x' Mb"
 	set mem `x'M
}

on my 64-bit Linux system with 8GB of memory without any problems. (I
haven't, loaded any data though)

Uli

Am Dienstag, den 12.01.2010, 14:09 +0100 schrieb Joachim Landström:
> Neil,
> From what I have read on the subject, my understanding is as follows. 
> 
> Both 32-bit and 64-bit systems run under the same sort of memory limitation
> independently of operating system (Linux/Win). No operating system allows
> programs to use more than 50 percent of RAM. Since 32-bit systems only can
> use a maximum of 4 GB RAM, it follows that a 32-bit system cannot allocate
> more than 2 GB of RAM. 64-bit systems can use, from what I have heard, an
> unlimited amount of RAM but they will still not allocate more than maximum
> 50 percent of RAM to other programs. 
> 
> Thus, in your case, your system will not allocate more than maximum 2GB RAM
> to programs despite your 64-bit system. But if you increase the amount of
> physical RAM to 8GB you should be able to allocate up to 4 GB of RAM to
> programs and consequently set the Stata memory to much higher than 1.3 GB.
> 
> /Joachim
> 
> 
> 
> -----Original Message-----
> From: [email protected]
> [mailto:[email protected]] On Behalf Of Neil Shephard
> Sent: Tuesday, January 12, 2010 11:19 AM
> To: [email protected]
> Subject: Re: AW: AW: st: Increasing Stata Memory
> 
> I noticed the other day that on my GNU/Linux system with 4Gb of RAM
> and support enabled in the kernel for such an amount of RAM that under
> my 64-bit installation I'm unable to allocate more than 1.3Gb...
> 
> . about
> 
> Stata/IC 11.0 for Unix (Linux 64-bit x86-64)
> Born 21 Oct 2009
> Copyright (C) 1985-2009
> 
> <--- snip --->
> 
> . forval x = 1000(10)2000{
>   2. di "Trying to set memory to `x' Mb"
>   3. set mem `x'M
>   4. }
> Trying to set memory to 1000 Mb
> (1024000k)
> Trying to set memory to 1010 Mb
> (1034240k)
> Trying to set memory to 1020 Mb
> (1044480k)
> Trying to set memory to 1030 Mb
> (1054720k)
> Trying to set memory to 1040 Mb
> (1064960k)
> Trying to set memory to 1050 Mb
> (1075200k)
> Trying to set memory to 1060 Mb
> (1085440k)
> Trying to set memory to 1070 Mb
> (1095680k)
> Trying to set memory to 1080 Mb
> (1105920k)
> Trying to set memory to 1090 Mb
> (1116160k)
> Trying to set memory to 1100 Mb
> (1126400k)
> Trying to set memory to 1110 Mb
> (1136640k)
> Trying to set memory to 1120 Mb
> (1146880k)
> Trying to set memory to 1130 Mb
> (1157120k)
> Trying to set memory to 1140 Mb
> (1167360k)
> Trying to set memory to 1150 Mb
> (1177600k)
> Trying to set memory to 1160 Mb
> (1187840k)
> Trying to set memory to 1170 Mb
> (1198080k)
> Trying to set memory to 1180 Mb
> (1208320k)
> Trying to set memory to 1190 Mb
> (1218560k)
> Trying to set memory to 1200 Mb
> (1228800k)
> Trying to set memory to 1210 Mb
> (1239040k)
> Trying to set memory to 1220 Mb
> (1249280k)
> Trying to set memory to 1230 Mb
> (1259520k)
> Trying to set memory to 1240 Mb
> (1269760k)
> Trying to set memory to 1250 Mb
> (1280000k)
> Trying to set memory to 1260 Mb
> (1290240k)
> Trying to set memory to 1270 Mb
> (1300480k)
> Trying to set memory to 1280 Mb
> op. sys. refuses to provide memory
> r(909);
> 
> !uname -a
> Linux morgan 2.6.31-tuxonice #6 SMP Wed Dec 9 13:26:25 GMT 2009 x86_64
> Intel(R) Core(TM)2 Duo CPU E8500 @ 3.16GHz GenuineIntel GNU/Linux
> 
> ...which surprised me as its 64-bit OS and Stata (static install as I
> had issues with some of the GUI libraries).
> 
> Neil



*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/



© Copyright 1996–2024 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   What's new   |   Site index