Re: st: RE: Kappa query - unequal distribution of scores

["Seyi Soremekun" <Seyi.Soremekun@lshtm.ac.uk>]

I am away from the 21st September until the 12th October. Please direct any urgent enquiries to Linda Vesel (linda.vesel@lshtm.ac.uk).
Seyi

>>> Nick Cox <njcoxstata@gmail.com> 09/22/11 10:36 >>>

I'd think about bootstrapping here. Other advice is to use "Stata" not "STATA".

On Thu, Sep 22, 2011 at 10:06 AM, Downs, Sara
<Sara.Downs@ahvla.gsi.gov.uk> wrote:
> Hi,
>
> I am trying to calculate agreement between 2 distributions of scores.
> There are 3 possible scores: One score predominates and the other 2 are
> extremely rare :
>
>  tab rev1 rev2
>
>           |               rev2
>      rev1 |         0          1          2 |     Total
> -----------+---------------------------------+----------
>         0 |         1          6          0 |         7
>         1 |        13         57          3 |        73
>         2 |         0          2          1 |         3
> -----------+---------------------------------+----------
>     Total |        14         65          4 |        83
>
>
> .         kap rev1 rev2
>
>             Expected
> Agreement   Agreement     Kappa   Std. Err.         Z      Prob>Z
> -----------------------------------------------------------------
>  71.08%      70.47%     0.0206     0.0852       0.24      0.4042
>
>
> I understand that the usual kappa statistic is not reliable in this
> situation .   Is there any way in STATA that I can adjust for the high
> expected frequency. I am using STATA 10.1.
>

*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/


*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/statalist/faq
*   http://www.ats.ucla.edu/stat/stata/