transist / echidna-spider

0 stars 0 forks source link

/get/group_ids api {"birth_year"=>"0" ... #19

Closed rngadam closed 11 years ago

rngadam commented 11 years ago

Looking at the logs, I only see birth_year 0? is this normal?

Mar 06 10:22:31 echidna1 echidna1:  [flyerhzm:spider][9914]: Tencent Weibo agent flyerhzm: Publishing tweet 242123132016149
Mar 06 10:22:31 echidna1 echidna1:  [flyerhzm:spider][9914]: Tencent Weibo agent flyerhzm: Cache hit: GET api/user/other_info {:name=>"songxiaobo"}
Mar 06 10:22:31 echidna1 echidna1:  [flyerhzm:streaming][9851]: /get_group_ids api received: {"birth_year"=>"0", "city"=>"上海", "gender"=>"male"}
flyerhzm commented 11 years ago

if user didn't set their birth year, it is 0, and streaming will add them to group-other panel

On Wed, Mar 6, 2013 at 10:23 AM, Ricky Ng-Adam notifications@github.comwrote:

Looking at the logs, I only see birth_year 0? is this normal?

Mar 06 10:22:31 echidna1 echidna1: [flyerhzm:spider][9914]: Tencent Weibo agent flyerhzm: Publishing tweet 242123132016149 Mar 06 10:22:31 echidna1 echidna1: [flyerhzm:spider][9914]: Tencent Weibo agent flyerhzm: Cache hit: GET api/user/other_info {:name=>"songxiaobo"} Mar 06 10:22:31 echidna1 echidna1: [flyerhzm:streaming][9851]: /get_group_ids api received: {"birth_year"=>"0", "city"=>"上海", "gender"=>"male"}

— Reply to this email directly or view it on GitHubhttps://github.com/transist/echidna-spider/issues/19 .

Best regards, Richard Huang

http://huangzhimin.com http://www.huangzhimin.comhttp://rails-bestpractices.com, http://railsbp.com https://github.com/flyerhzm http://github.com/flyerhzm, https://github.com/railsbp @flyerhzm, @railsbp

rngadam commented 11 years ago

what percentage of the users did not enter their birth year? Because I have yet to see anything else than zero...

flyerhzm commented 11 years ago

I will check with Rainux see the percentage of users he crawl last night

On Wed, Mar 6, 2013 at 10:31 AM, Ricky Ng-Adam notifications@github.comwrote:

what percentage of the users did not enter their birth year? Because I have yet to see anything else than zero...

— Reply to this email directly or view it on GitHubhttps://github.com/transist/echidna-spider/issues/19#issuecomment-14478850 .

Best regards, Richard Huang

http://huangzhimin.com http://www.huangzhimin.comhttp://rails-bestpractices.com, http://railsbp.com https://github.com/flyerhzm http://github.com/flyerhzm, https://github.com/railsbp @flyerhzm, @railsbp

rainux commented 11 years ago

I've did some grep in the cache data, we've sampled 119 users so far, and 99 of them didn't enter birth year, the percentage is 83%.

rainux commented 11 years ago

Hi Richard,

Looks like you should stop skillpages.com to send emails out with your account, it's behavior should consider as spam.

On Thu, Mar 21, 2013 at 8:06 AM, Richard Huang notifications@github.comwrote:

< http://www.skillpages.com/i/ftuf/emailinvitelanding?user=bb17c8cc-be86-e211-bb20 -b4fd0eafa145&signedParameters=x5QVc5Y3cRczUDT6uVWIfpyaaLYv9spRmicuNaGDbIM.eyJlbW

FpbCI6InJlcGx5K2ktMTE2OTY3MDMtNjA3MWQ4NTg1Y2M0MDM2OTkxMjIzOWI1ZTRkNzc0ZjA1YTQ3YTR

lMy02NjgzNkByZXBseS5naXRodWIuY29tIiwiZnJvbSI6ImJiMTdjOGNjLWJlODYtZTIxMS1iYjIwLWI0

ZmQwZWFmYTE0NSIsInRvIjoiNzFhNzNhYjctMmU4NS01MTM1LWJlYzAtYzhiNmNiZWVhOWQ0IiwiaXNzd

WVkX2F0IjoiMTM2MzgyNDQwNiIsInZlciI6IjEiLCJwIjoiMyJ9&emailMessageId=ccdf19d5-ba91-

e211-bbf5-8d1ec1186671&emailType=InviteSecondReminder&sdate=201303210006&utm_sour

ce=EmailInviteSecondReminder&utm_medium=Email&emailLinkType=Logo>

Hi,

Richard Huang is still waiting to connect with you.

< http://www.skillpages.com/i/ftuf/emailinvitelanding?user=bb17c8cc-be86-e211-bb20 -b4fd0eafa145&signedParameters=x5QVc5Y3cRczUDT6uVWIfpyaaLYv9spRmicuNaGDbIM.eyJlbW

FpbCI6InJlcGx5K2ktMTE2OTY3MDMtNjA3MWQ4NTg1Y2M0MDM2OTkxMjIzOWI1ZTRkNzc0ZjA1YTQ3YTR

lMy02NjgzNkByZXBseS5naXRodWIuY29tIiwiZnJvbSI6ImJiMTdjOGNjLWJlODYtZTIxMS1iYjIwLWI0

ZmQwZWFmYTE0NSIsInRvIjoiNzFhNzNhYjctMmU4NS01MTM1LWJlYzAtYzhiNmNiZWVhOWQ0IiwiaXNzd

WVkX2F0IjoiMTM2MzgyNDQwNiIsInZlciI6IjEiLCJwIjoiMyJ9&emailMessageId=ccdf19d5-ba91-

e211-bbf5-8d1ec1186671&emailType=InviteSecondReminder&sdate=201303210006&utm_sour

ce=EmailInviteSecondReminder&utm_medium=Email&emailLinkType=ProfileThumb>

Richard Huang < http://www.skillpages.com/i/ftuf/emailinvitelanding?user=bb17c8cc-be86-e211-bb20 -b4fd0eafa145&signedParameters=x5QVc5Y3cRczUDT6uVWIfpyaaLYv9spRmicuNaGDbIM.eyJlbW

FpbCI6InJlcGx5K2ktMTE2OTY3MDMtNjA3MWQ4NTg1Y2M0MDM2OTkxMjIzOWI1ZTRkNzc0ZjA1YTQ3YTR

lMy02NjgzNkByZXBseS5naXRodWIuY29tIiwiZnJvbSI6ImJiMTdjOGNjLWJlODYtZTIxMS1iYjIwLWI0

ZmQwZWFmYTE0NSIsInRvIjoiNzFhNzNhYjctMmU4NS01MTM1LWJlYzAtYzhiNmNiZWVhOWQ0IiwiaXNzd

WVkX2F0IjoiMTM2MzgyNDQwNiIsInZlciI6IjEiLCJwIjoiMyJ9&emailMessageId=ccdf19d5-ba91-

e211-bbf5-8d1ec1186671&emailType=InviteSecondReminder&sdate=201303210006&utm_sour

ce=EmailInviteSecondReminder&utm_medium=Email&emailLinkType=ProfileName>

Invite sent: 7 March, 2013

Continue < http://www.skillpages.com/i/ftuf/emailinvitelanding?user=bb17c8cc-be86-e211-bb20 -b4fd0eafa145&signedParameters=x5QVc5Y3cRczUDT6uVWIfpyaaLYv9spRmicuNaGDbIM.eyJlbW

FpbCI6InJlcGx5K2ktMTE2OTY3MDMtNjA3MWQ4NTg1Y2M0MDM2OTkxMjIzOWI1ZTRkNzc0ZjA1YTQ3YTR

lMy02NjgzNkByZXBseS5naXRodWIuY29tIiwiZnJvbSI6ImJiMTdjOGNjLWJlODYtZTIxMS1iYjIwLWI0

ZmQwZWFmYTE0NSIsInRvIjoiNzFhNzNhYjctMmU4NS01MTM1LWJlYzAtYzhiNmNiZWVhOWQ0IiwiaXNzd

WVkX2F0IjoiMTM2MzgyNDQwNiIsInZlciI6IjEiLCJwIjoiMyJ9&cnId=bb17c8cc-be86-e211-bb20-

b4fd0eafa145&emailMessageId=ccdf19d5-ba91-e211-bbf5-8d1ec1186671&emailType=Invite

SecondReminder&sdate=201303210006&utm_source=EmailInviteSecondReminder&utm_medium

=Email&emailLinkType=MainCallToAction>

reply@reply.github.com was invited to join SkillPages by Richard Huang. To stop receiving emails from SkillPages click here < http://www.skillpages.com/i/account/unsubscribe?signedParameters=3E3MmaFT7S5XKsf hC98jnE0mAYCvNp2BSF3DXKhlBZg.eyJlbWFpbCI6InJlcGx5K2ktMTE2OTY3MDMtNjA3MWQ4NTg1Y2M0

MDM2OTkxMjIzOWI1ZTRkNzc0ZjA1YTQ3YTRlMy02NjgzNkByZXBseS5naXRodWIuY29tIiwiaXNzdWVkX

2F0IjoiMTM2MzgyNDQwNiIsInZlciI6IjEiLCJwIjoiMCJ9&emailMessageId=ccdf19d5-ba91-e211

-bbf5-8d1ec1186671&emailType=InviteSecondReminder&sdate=201303210006&utm_source=E

mailInviteSecondReminder&utm_medium=Email&emailLinkType=Unsubscribe> .

© 2013 SkillPages, Blackrock Business Park, Dublin, Ireland and 228 Hamilton Avenue, 3rd Floor, Palo Alto, CA 94301.

Reply to this email directly or view it on GitHubhttps://github.com/transist/echidna-spider/issues/19#issuecomment-15211983 .

flyerhzm commented 11 years ago

sorry, I already revoked its access, but I don't know why it still sent emails