stamaimer / TwitterSentimentAnalysis

0 stars 3 forks source link

数据清洗错误 #2

Open lunrongchen opened 10 years ago

lunrongchen commented 10 years ago

////////////////////////////////////////////////////////////////////////////////////// 第一类: 单词.单词 word.word

//////////////////////////////////////////////////////////////////////////////////

“@Yahoo: U.S. says recordings of Ukraine rebels admitting #MH17 downing are ‘authentic’: http://t.co/rtl3UWEafG

USERNAME U S says recordings of Ukraine rebels admitting MH17 downing are 'authentic'

username u s says recordings of ukraine rebels admitting mh17 downing are 'authentic ' username u s says recordings of ukraine rebels admitting mh17 downing are ' authentic '


mh17 changed my avatar out of respect and until the victims are home. R.I.P #bringthemhome #dutch


mh17 changed my avatar out of respect and until the victims are home R I P bringthemhome dutch

mh17 changed my avatar out of respect and until the victims are home r i p bringthemhome dutch mh17 changed my avatar out of respect and until the victims are home r i p bringthemhome dutch

///////////////////////////////////////////////////////////////////// 第二类: &amp , &

///////////////////////////////////////////////

RT @JustHovensGreve: Biggest Dutch newspaper,Telegraaf, asks for military intervention by NATO to protect #MH17 & calls Putin a KGB liar. h…

Biggest Dutch newspaper Telegraaf asks for military intervention by NATO to protect MH17 & calls Putin a KGB liar h…

biggest dutch newspaper telegraaf asks for military intervention by nato to protect mh17 & calls putin a kgb liar h… biggest dutch newspaper telegraaf asks for military intervention by nato to protect mh17 & calls putin a kgb liar h …


RT @noclador: Two camera bags+a bag at #MH17 site in #Ukraine. Zippers have been opened & content stolen by #Putin's #Russia goons. http://…

Two camera bags+a bag at MH17 site in Ukraine Zippers have been opened & content stolen by Putin's Russia goons

two camera bags+a bag at mh17 site in ukraine zippers have been opened & content stolen by putin 's russia goons two camera bags + a bag at mh17 site in ukraine zippers have been opened & content stolen by putin's russia goons


10 Things You Need To Know As Asian Markets Open - Good morning. The world’s still reeling from the MH17 cra... http://t.co/YqlyIUDVb5

10 Things You Need To Know As Asian Markets Open Good morning The world&rsquo s still reeling from the MH17 cra

10 things you need to know as asian markets open good morning the world & rsquo s still reeling from the mh17 cra 10 things you need to know as asian markets open good morning the world & rsquo s still reeling from the mh17 cra


MH17 #BBC It's a forensic scene & not fully accessible by international investigators.Vital evidence is being removed.Dignity disrespected.


MH17 BBC It's a forensic scene & not fully accessible by international investigators Vital evidence is being removed Dignity disrespected

mh17 bbc it 's a forensic scene & not fully accessible by international investigators vital evidence is being removed dignity disrespected mh17 bbc it's a forensic scene & not fully accessible by international investigators vital evidence is being removed dignity disrespected

&amp????

//////////////////////////////////////////////////////////////////// 第三类: 括号内字符缺失 () /////////////////////////////////////////////////////////////////////////


RT @HaraldDoornbos: #MH17 Ex Dutch int footballer John van 't Schip (ex-Ajax) calls for boycott of 2018 FIFA World Cup in Russia. His hand…

MH17 Ex Dutch int footballer John van 't Schip calls for boycott of 2018 FIFA World Cup in Russia His hand…

mh17 ex dutch int footballer john van 't schip calls for boycott of 2018 fifa world cup in russia his hand… mh17 ex dutch int footballer john van ' t schip calls for boycott of 2018 fifa world cup in russia his hand …


RT @Catherina_News: OSCE observers say they have access to #MH17 crash site in eastern Ukraine (despite Kiev/Psaki's hysterical claim)

http…

OSCE observers say they have access to MH17 crash site in eastern Ukraine


osce observers say they have access to mh17 crash site in eastern ukraine osce observers say they have access to mh17 crash site in eastern ukraine


RT @tunkuv: Take the 2018 World Cup away from Russia (and give it to the Netherlands...)... http://t.co/bF5REBhvOv via @tunkuv #MH17 #Putin

Take the 2018 World Cup away from Russia via USERNAME MH17 Putin

take the 2018 world cup away from russia via username mh17 putin take the 2018 world cup away from russia via username mh17 putin


RT @tunkuv: Take the 2018 World Cup away from Russia (and give it to the Netherlands...)... http://t.co/bF5REBhvOv via @tunkuv #MH17 #Putin

Take the 2018 World Cup away from Russia via USERNAME MH17 Putin

take the 2018 world cup away from russia via username mh17 putin take the 2018 world cup away from russia via username mh17 putin


RT @starflyergold: Russian separatists removing wreckage at the #MH17 scene. (unbelievable) http://t.co/GFGhoUsda4

Russian separatists removing wreckage at the MH17 scene

russian separatists removing wreckage at the mh17 scene russian separatists removing wreckage at the mh17 scene


Whoever shot down #MH17 repeated what the #USA did on 3 July 1988 (exactly 26yrs ago) shooting down #Iran flight 655 & killing 290 people

Whoever shot down MH17 repeated what the USA did on 3 July 1988 shooting down Iran flight 655 & killing 290 people

whoever shot down mh17 repeated what the usa did on 3 july 1988 shooting down iran flight 655 & killing 290 people whoever shot down mh17 repeated what the usa did on 3 july 1988 shooting down iran flight 655 & killing 290 people

//////////////////////////////////////////////////////////////////////////////////

第四类:表情符号处理 ;(; emoticon

//////////////////////////////////////////////////////////////////////////////////

RT @DrakeVsLilWayne: Drake doing the #ALSIceBucketChallenge . Every RT we receive we will donate $1 http://t.co/HPh6SbaX8T

Drake doing the ALSIceBucketChallenge Every RT we receive we will donate 1

drake doing the alsicebucketchallenge every rt we receive we will donate 1 drake doing the alsicebucketchallenge every rt we receive we will donate 1


obvio ;)

obvio

obvio obvio


//here if anyone wants to RP. :)

here if anyone wants to RP

here if anyone wants to rp here if anyone wants to rp


A real ass nigga hard to come by -_-

A real ass nigga hard to come by -

a real ass nigga hard to come by - a real ass nigga hard to come by -


Just showing that fucking Crash Of #MH17 Was Awful @MAS That plane was Smarty Shot -Down.

RIP #MH17 :(


Just showing that fucking Crash Of MH17 Was Awful USERNAME That plane was Smarty Shot -Down

RIP MH17

just showing that fucking crash of mh17 was awful username that plane was smarty shot -down rip mh17 just showing that fucking crash of mh17 was awful username that plane was smarty shot - down rip mh17


What the bloody hell is going on in the world at the moment!!! :-( #Gaza #MH17

What the bloody hell is going on in the world at the moment Gaza MH17

what the bloody hell is going on in the world at the moment gaza mh17 what the bloody hell is going on in the world at the moment gaza mh17

///////////////////////////////////////////////////////////////////////// 第五类:数字与数字之间的逗号 number,number,number ///////////////////////////////////////////////////////////////////////


RT @luke_brooks: 2,000,000 followers!!! Before I continue to thank you guys, I'd just like to take this moment to reflect on #MH17 and all …

2 000 000 followers Before I continue to thank you guys I'd just like to take this moment to reflect on MH17 and all …

2 000 000 followers before i continue to thank you guys i 'd just like to take this moment to reflect on mh17 and all … 2 000 000 followers before i continue to thank you guys i'd just like to take this moment to reflect on mh17 and all …

////////////////////////////////////////////////////////////////////// 第六类:特殊符号

-> /////////////////////////////////////////////////////////////////////////////////////////


RT @janinebucks: California USA Richmond » http://t.co/aFCyb43BEe #MalaysiaAirlines 850 Malaysian Airlines Flight MH17 crash: What we know…

California USA Richmond » MalaysiaAirlines 850 Malaysian Airlines Flight MH17 crash What we know…

california usa richmond » malaysiaairlines 850 malaysian airlines flight mh17 crash what we know… california usa richmond » malaysiaairlines 850 malaysian airlines flight mh17 crash what we know …


RT @janinebucks: California USA Richmond » http://t.co/aFCyb43BEe #MalaysiaAirlines 850 Malaysian Airlines Flight MH17 crash: What we know…

California USA Richmond » MalaysiaAirlines 850 Malaysian Airlines Flight MH17 crash What we know…

california usa richmond » malaysiaairlines 850 malaysian airlines flight mh17 crash what we know… california usa richmond » malaysiaairlines 850 malaysian airlines flight mh17 crash what we know …


RT @daniellemcxs: » NEWS » http://t.co/JCA4mD12FM HOT NEWS 691 Malaysia Airlines Malaysia Airlines plane MH17: wars have bloomed from far, …

» NEWS » HOT NEWS 691 Malaysia Airlines Malaysia Airlines plane MH17 wars have bloomed from far …

» news » hot news 691 malaysia airlines malaysia airlines plane mh17 wars have bloomed from far … » news » hot news 691 malaysia airlines malaysia airlines plane mh17 wars have bloomed from far …


RT @News24lHOT: → USA http://t.co/MtMlEso6MY → MH17 crash: Tragic twists of fate and lucky escapes USA → Although Irene never met Maree and…

→ USA → MH17 crash Tragic twists of fate and lucky escapes USA → Although Irene never met Maree and…

→ usa → mh17 crash tragic twists of fate and lucky escapes usa → although irene never met maree and… → usa → mh17 crash tragic twists of fate and lucky escapes usa → although irene never met maree and …

→????