domspad / text_viz_project

developing a set of tools to analyze and quantify texts
0 stars 0 forks source link

segment in to words misses hyphens #11

Open domspad opened 9 years ago

domspad commented 9 years ago

unsegmented by current implementation :

thirteen-and-a-half
Grow-Your-Own-Warts
He-Who-Must-Not-Be-Named
    immorality--nobody
irrelevant'n'immaterial
I-got-you-that-book-so-go-read-it
now--you've-got-it-go-play-with-it
the-son-of-a-bitch-had-itcoming-to-him

run median_lengths.py to see more

for solution check out link to string splitting on multiple delims