Summarize choice data
Model discrete choices
Conditional logit
Mixed logit
Multinomial probit
Rank-ordered logit
Rank-ordered probit
Truly interpret the results
Expected probabilities
For any alternative
For any subpopulation
At specific covariate level
Differences in probabilities of selecting alternativess
As a covariate changes for this alternative
As a covariate changes for another alternative
As a covariate changes for all alternatives
Marginal effects
Tests and confidence intervals for everything
Finally, answers to real-world and real-research questions.
The nonlinearities and extra correlations in most choice models made it difficult to answer truly interesting questions. You could easily test whether a covariate was significant and positive but not measure its effect on the probability of a choice. Either you accepted answers to limited questions or you derived solutions to your specific questions and programmed them by hand.
That's all changed. Even with complicated models such as multinomial probit or mixed logit, you can get the answers to truly interesting questions. Your favorite restaurant introduces a new chicken entree? How does that affect demand for its other chicken entrees? Its beef entrees? Its fish entrees?
With Stata, answers to such questions, including tests and confidence intervals, are a simple command away.
We are consistently faced with making choices. For example:
Individuals choose their favorite breakfast cereal,
Companies choose whether to use TV, online, or print advertising,
Travelers choose whether to take a car, airplane, or train.
With choice models, you can analyze relationships between such choices and variables that influence them.
Stata has a unified suite of features for modeling choice data. The commands are easy to use, and they provide the most powerful tools available for interpreting choice model results.
To get started with any choice model analysis, you first cmset your data, say,
. cmset id travelmode
You are now ready to summarize your choice data, fit models, and interpret the results.
Summarize:
With the commands cmsummarize, cmchoiceset, cmtab, and cmsample, you can explore, summarize, and look for potential problems in your choice data.
Model:
Stata's commands for fitting choice models have been improved and renamed. You can use the cm estimation commands to fit the following choice models:
| cmclogit | conditional logit (McFadden's choice) model |
| cmmixlogit | mixed logit model |
| cmxtmixlogit | panel-data mixed logit model |
| cmmprobit | multinomial probit model |
| cmroprobit | rank-ordered probit model |
| cmrologit | rank-ordered logit model |
| cmxtmixlogit | another feature of Stata. It fits mixed logit models for panel data, and we tell you all about it here. |
Interpret:
Here's the most exciting part: margins works after fitting any of these choice models. This means you can easily interpret the results of your choice models. While the coefficients estimated in choice models are often almost uninterpretable, margins allows you to ask and answer very specific questions based on your results.
If you are modeling choice of transportation mode, you might ask questions such as
What proportion of travelers are expected to choose air travel?
How does the probability of traveling by car change for each additional $10,000 in income?
If wait times at the airport increase by 30 minutes, how does this affect the choice of each mode of transportation?
margins provides the answers to these questions and many others.
We have data recording individuals' choices of travel method between two cities.
Contains data from travel2.dta
Observations: 840 Modes of travel
Variables: 7 4 Apr 2023 17:15
| Variable Storage Display Value | ||
| name type format label Variable label | ||
| chosen byte %8.0g Travel mode chosen | ||
| income byte %8.0g Household income | ||
| partysize byte %8.0g Party size | ||
| id int %9.0g ID code | ||
| mode byte %8.0g travel Travel mode | ||
| time float %9.0g Travel time | ||
| income_cat byte %8.0g quart Income quartiles | ||
To begin our analysis of these choice data, we tell Stata that the id variable identifies the cases (individuals) and the mode variable identifies the alternatives (modes of travel).
. cmset id mode
Case ID variable: id
Alternatives variable: mode
Before fitting a model, let's learn a little more about our data. cmtab shows us the proportion of individuals that chose each model of transportation. The option choice(chosen) says that the variable named chosen in our dataset records each individual's chosen travel mode.
. cmtab, choice(chosen) Tabulation of chosen alternatives (chosen = 1)
Travel mode Freq. Percent Cum. Air 58 27.62 27.62 Train 63 30.00 57.62 Bus 30 14.29 71.90 Car 59 28.10 100.00 Total 210 100.00
Train transportation was most frequently chosen, but just slightly more often than air or car transportation. Only 14% of individuals took a bus.
We are interested in the effect of income on the chosen travel mode. Before we fit our model, let's look at the mean income for those who selected each travel mode.
. cmsummarize income, choice(chosen)
Statistics by chosen alternatives (chosen = 1)
income is constant within case
Summary for variables: income
Group variable: _chosen_alternative (chosen = 1)
_chosen_alternative Mean Air 41.72414 Train 23.06349 Bus 29.7 Car 42.22034 Total 34.54762
Not surprisingly, average income is the highest among those who choose to travel by air and by car.
Now, let's fit a model and see what the results tell us about this relationship and others. To demonstrate, we fit a conditional logistic regression model using cmclogit, but the analysis that follows could be performed after fitting any other choice model.
We will include travel time, income, and the number of individuals traveling together (partysize) as covariates in our model. Travel time differs for each mode of transportation; it is called an alternative-specific variable. Income and party size do not vary across alternatives for an individual; they are known as case-specific variables and are listed in the casevars() option.
. cmclogit chosen time, casevars(income partysize)
Iteration 0: Log likelihood = -249.36629
Iteration 1: Log likelihood = -236.01608
Iteration 2: Log likelihood = -235.65162
Iteration 3: Log likelihood = -235.65065
Iteration 4: Log likelihood = -235.65065
Conditional logit choice model Number of obs = 840
Case ID variable: id Number of cases = 210
Alternatives variable: mode Alts per case: min = 4
avg = 4.0
max = 4
Wald chi2(7) = 71.14
Log likelihood = -235.65065 Prob > chi2 = 0.0000
| chosen | Coefficient Std. err. z P>|z| [95% conf. interval] | |
| mode | ||
| time | -.0041641 .0007588 -5.49 0.000 -.0056512 -.002677 | |
| Air | (base alternative) | |
| Train | ||
| income | -.0613414 .0122637 -5.00 0.000 -.0853778 -.0373051 | |
| partysize | .4123606 .2406358 1.71 0.087 -.0592769 .883998 | |
| _cons | 3.39349 .6579166 5.16 0.000 2.103997 4.682982 | |
| Bus | ||
| income | -.0363345 .0134318 -2.71 0.007 -.0626605 -.0100086 | |
| partysize | -.1370778 .3437092 -0.40 0.690 -.8107354 .5365798 | |
| _cons | 2.919314 .7658496 3.81 0.000 1.418276 4.420351 | |
| Car | ||
| income | -.0096347 .0111377 -0.87 0.387 -.0314641 .0121947 | |
| partysize | .7350802 .2184636 3.36 0.001 .3068993 1.163261 | |
| _cons | .7471042 .6732971 1.11 0.267 -.5725338 2.066742 | |
What can we determine from these results? The coefficient on time is negative, so the probability of choosing any method of travel decreases as its travel time increases.
For the train alternative, the coefficient on income is negative. Because air travel is the base alternative, this negative coefficient tells us that as income increases, people are less likely to choose a train over an airplane. For the car alternative, the coefficient on partysize is positive. As party size increases, people are more likely to choose a car over an airplane.
But what about questions that we can't answer from this output? For instance, what happens to the probability of selecting car travel as income increases? This is where margins comes in.
Let's estimate the expected proportion of travelers who would choose car travel across income levels ranging from $30,000 to $70,000 per year.
. margins, at(income=(30(10)70)) outcome(Car) Predictive margins Number of obs = 840 Model VCE: OIM Expression: Pr(mode|1 selected), predict() Outcome: Car 1._at: income = 30 2._at: income = 40 3._at: income = 50 4._at: income = 60 5._at: income = 70
| Delta-method | ||
| Margin std. err. z P>|z| [95% conf. interval] | ||
| _at | ||
| 1 | .2717914 .0329811 8.24 0.000 .2071497 .3364331 | |
| 2 | .3169817 .0329227 9.63 0.000 .2524544 .3815091 | |
| 3 | .3522391 .0391994 8.99 0.000 .2754097 .4290684 | |
| 4 | .3760093 .050679 7.42 0.000 .2766802 .4753383 | |
| 5 | .3889296 .0655865 5.93 0.000 .2603825 .5174768 | |
In the first line, we see that at the $30,000 income level, 27% of travelers are expected to choose car travel. But at the $70,000 income level, 39% are expected to choose car travel.
If we simply type marginsplot, we can easily visualize the effect of income.
;)
We see that the expected probability of choosing car transportation increases as income increases. But are these differences statistically significant?
We can again use margins to answer this question. Specifying the contrast() option, we can test for differences in the expected probabilities for each $10,000 increase in income. The atcontrast(ar) option requests reverse adjacent contrasts—comparisons with the previous income level.
. margins, at(income=(30(10)70)) outcome(Car) contrast(atcontrast(ar) nowald
effects)
Contrasts of predictive margins Number of obs = 840
Model VCE: OIM
Expression: Pr(mode|1 selected), predict()
Outcome: Car
1._at: income = 30
2._at: income = 40
3._at: income = 50
4._at: income = 60
5._at: income = 70
| Delta-method | ||
| Contrast std. err. z P>|z| [95% conf. interval] | ||
| _at | ||
| (2 vs 1) | .0451903 .016664 2.71 0.007 .0125296 .0778511 | |
| (3 vs 2) | .0352574 .017903 1.97 0.049 .0001681 .0703466 | |
| (4 vs 3) | .0237702 .0190387 1.25 0.212 -.013545 .0610854 | |
| (5 vs 4) | .0129204 .0200549 0.64 0.519 -.0263866 .0522273 | |
At a 5% significance level, the effect of a $10,000 increase in income is statistically significant only when going from $30,000 to $40,000 (2 vs 1) and from $40,000 to $50,000 (3 vs 2).
Above, we have results for car travel, but we can easily estimate similar effects for each other travel alternative. We simply change outcome(Car) to outcome(Train) or any of the other outcomes. Or we can remove the outcome() option altogether and get estimates for all outcomes. This is helpful if you want to compare effects of income across all modes of transportation. For instance, if we type
. margins, at(income=(30(10)70)) . marginsplot, noci
we see how the expected probability of selecting each transportation mode changes across income levels.
;)
So far, we have focused on the effects of income. What about analyzing the effect of an alternative-specific variable like time? We can ask different questions for these variables. For instance, if wait times at airports increase by an hour, how do we expect this to affect the probability of selecting air travel? How does it affect the probability of selecting car travel? Train travel? Bus travel?
We find out by typing
. margins, at(time=generate(time)) at(time=generate(time+60)) alternative(Air)
The first at() option requests expected probabilities without the additional travel time, and the second at() option requests expected probabilities with an additional 60 minutes added to air travel time.
| Delta-method | ||
| Margin std. err. z P>|z| [95% conf. interval] | ||
| _outcome#_at | ||
| Air#1 | .2761905 .0275268 10.03 0.000 .2222389 .330142 | |
| Air#2 | .2379693 .0258772 9.20 0.000 .1872509 .2886878 | |
| Train#1 | .3 .0284836 10.53 0.000 .2441731 .3558269 | |
| Train#2 | .3134023 .0293577 10.68 0.000 .2558623 .3709424 | |
| Bus#1 | .1428571 .0234186 6.10 0.000 .0969576 .1887567 | |
| Bus#2 | .1514859 .024598 6.16 0.000 .1032747 .1996972 | |
| Car#1 | .2809524 .028043 10.02 0.000 .2259891 .3359156 | |
| Car#2 | .2971424 .0289281 10.27 0.000 .2404443 .3538405 | |
Not surprisingly, we see a decrease in the expected probability of traveling by air from 0.276 to 0.238. The expected probabilities of selecting any of the other travel modes increase slightly.
Again, we can use marginsplot to visualize the effect of this change in air travel time.
;)
Here we have given you only a taste of the types of analyses you can perform using margins.
For more about inference using margins, see [CM] Intro 1.
Learn more about Stata's choice model features.
Read more about Stata's commands for choice models in the Stata Choice Models Reference Manual.
