Dear Marten and Nick:
Thank you for your very detailed and instructive replies. I have no problem with it.
Best regards
Herv�
***********************************************************
HEC Paris
D�partement Comptabilit�-Contr�le de gestion / Dept of Accounting and Management Control
1, rue de la Liberation
78351 - Jouy-en-Josas
France
Tel: +33 1 39 67 94 42
Fax: +33 1 39 67 70 86
[email protected]
http://campus.hec.fr/profs/stolowy/perso/home.htm
>>> [email protected] 09/21 3:32 pm >>>
Dear Herv�,
Prob>LR in -fitstat- is the result of a likelihood ratio test comparing your model with a model with only the intercept, i.e. it is a test whether the parameters of ALL explanatory variables are SIMULTANEOUSLY zero. This is comparable to the F statistic reported for a `normal' (OLS) regression. A significant result only means that the parameter of at least one explanatory variable is different from zero. So I would not use it as a goodness-of-fit statistic.
More generally, I am sceptical about using a single measure of goodness-of-fit (including R^2 and the various pseudo R^2's), and I am not alone in that respect. To quote from the Long and Freese book I recommended earlier (p.88): ``[T]here is no convincing evidence that selecting a model that maximizes the value of a given measure results in a model that is optimal in any sense other than the model having a larger (or, in some instances, smaller) value of that measure.'' Apparently, the authors think this is a very important point since this sentence is printed in italics.
More specifically, Agresti (2002, p. 177) warns that the Hosmer-Lemeshow statistic you mentioned does not have good power for detecting particular types of lack of fit, i.e. you accept models as having a good fit (or more precisely you do not reject the hypothesis that the fit is bad), which should not be accepted.
When assessing model fit, I would do three things: 1) See if your model makes theoretical sense. 2) Test assumptions of your model. For instance, ordered logit assumes proportional odds, which can be tested with the -omodel- command (findit omodel). 3) Estimate more general models, and test restrictions, like gologit instead of ologit (this also is a test for the proportional odds assumption) or a model with more explanatory variables.
This may not be the answer you were looking for, but I hope it still helps,
Maarten
Agresti, Alan, (2002) Categorical Data Analysis, 2nd edition, Wiley (More comprehensive than the Long and Freese book, but also more terse)
*
* For searches and help try:
* http://www.stata.com/support/faqs/res/findit.html
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/
*
* For searches and help try:
* http://www.stata.com/support/faqs/res/findit.html
* http://www.stata.com/support/statalist/faq
* http://www.ats.ucla.edu/stat/stata/
