Bookmark and Share

Notice: On April 23, 2014, Statalist moved from an email list to a forum, based at statalist.org.


[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

st: Repeated names in a string variable, but some have typos. How to correct?


From   Lucas Ferreira Mation <[email protected]>
To   statalist <[email protected]>
Subject   st: Repeated names in a string variable, but some have typos. How to correct?
Date   Fri, 4 Apr 2014 12:29:24 -0300

statalisters,

I have a large addresses database, identifying street_names,  street_number
and city, which I need to collapse by street_name and city. Because the
street_names can have some typos for some street_numbers, when I collapse
some streets appear duplicated within cities (see example bellow)
Duplicated street_names between cities would be OK.

Is there a command to do some sort of probabilistic/fuzzy string comparison
among the rows of a string variable (similar to what reclink does but
with-in the variable)?

The dataset is quite large, after collapsing I get 2.3 million
cit-street_name pairs. So I need a smart way to go about it.


*Example of the data after collapsing:
clear
input str1 city str24 street_name number_of_obs
"A" "Rua Santos Dumont" 1200
"A" "Rua Santos Dummont" 30
"A" "Rua Satos Dumont" 3
"A" "Rua Bandim" 60
"B" "Rua Pedro Alvares Cabral" 4000
"B" "Rua Pedro Alvaers Cabral" 3
"B" "Rue Pedro Alvares Cabral" 1
"B" "Av. Pedro Alvares Cabral" 20
"B" "Rua other"  45
end
*
*   For searches and help try:
*   http://www.stata.com/help.cgi?search
*   http://www.stata.com/support/faqs/resources/statalist-faq/
*   http://www.ats.ucla.edu/stat/stata/


© Copyright 1996–2018 StataCorp LLC   |   Terms of use   |   Privacy   |   Contact us   |   Site index