thegooglecodearchive / allforgood

Automatically exported from code.google.com/p/allforgood
0 stars 0 forks source link

bad char encodings still slipping through (and --test isn't catching them, sigh...) #3

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago
here's two examples from usaservice (see the sample input & output)

There is a problem with the character encoding of this attribute.   help    
description:You Are Cordially Invited To Attend…  A Celebrity Cocktail 
Fundraiser Event    “Stars and Their Cars” “A Celebrity Fundraiser”   
Don’t 
miss “The” Orange County Event of The Year  “Celebrity 
guests…showcasing 
the finest car collections anywhere…  entertainment, silent auction, hors 
d’ oeuvres, no host bar, raffle, prizes”   Saturday March 8, 2009 - from 
4:00pm – 9:00pm   $125.00 dollar donation per person or $150.00 after Nov 
10th   The Newport Harbor Drivers Club - 729 Farad Street, Costa Mesa, CA 
92627   Must RSVP - Contact: Linda Velez at 949-400-4596 - call for credit 
card charges  Dress Code: Dressy / Casual   Payments to: “Russ Alexander-
Neuro Surgery Fund” 1048 Irvine Avenue, Suite 190, Newport Beach, CA 92660 
 No I will not be attending but I wish to donate $________  Yes I will 
attend I want _______ tickets x $125.00  Sponsored by: “The Ford Motor 
Company / The Center of Spiritual Discovery/ Russ Alexander Neuro Surgery 
Fund”  A US non-profit 501©3 Organization Tax ID # 330230768-695 West 19th 
Street, Costa Mesa, 9262727 -All proceeds to Russ Alexander Neuro Surgery 
Fund You can also sign up online at: www.OurFriendRuss.com and for more 
information on DBS: http://youtube.com/watch?v=IOHtUzW02cg
1048
There is a problem with the character encoding of this attribute.   help    
description:Our votes have created a great historical event, the reality of 
having a President Elect, Barack Obama, that may be able to bring much 
needed change to America. This is a great opportunity and I suspect that 
this country and the world will never be the same again. We know that the 
present economic situation is difficult. We need our President elect to 
lead the way and help us enter a new era of peace and prosperity.  
Olodumare, Orisha, Egun, & all the powers know the outcome, however 
IfÃmakes changing the course towards a better tomorrow possible through 
knowledge and propitiation. We as creatures of growth and evolution have 
great hopes for a better tomorrow filled with the belief that we are part 
of the solution.   For me, this means working to ensure that women and 
women's range of perspectives are included from top to bottom in the new 
Administration.  At this moment, I am calling on our President Elect to not 
only expand diversity, and represent all minoritites, but also include the 
leadership of women in his new team.   Our country, our world, this moment 
is calling upon us. We are in trouble and we need everyone to take a 
helping role.  You are "it."  Several years ago, after the tragedy of 9/11, 
some of us came together atop Twin Peaks in San Francisco and played "Bata" 
for everyone that was lost that day. Our religious community was very 
supportive. I felt that our praise songs and prayers were received. Now, we 
need to come together again as one religious community to sing and pray to 
the Orishas & the Ancestors to keep a protective eye over President Elect 
Barack Obama and his family throughout his entire term in office.  Each and 
everyone of you in our religious community is entreated to participate in 
the planning of this event from a desire to help our President Elect and to 
heal our nation.   To accomplish this event, we will need drummers, 
musicians in general, so bring your shekeres (beaded gourds), acheres 
(rattles), agogo (iron bells), etc., as well as singers. Most of all and of 
great importance is to attempt 100% religious community participation.  
This statement is a collaboration of concerned priests.  Alaafia,  Baba 
SomiLeke  California, .....  Please, I hope to hear from everyone for 
suggestions on where it would be the best place to come together as a 
religious community and which day of the week will be suitable for 
everyone. At your earliest convenience, please contact me at (415) 573-5525 
or email me somileke@yahoo.com.
1299

Original issue reported on code.google.com by adam.sah on 4 Mar 2009 at 2:00

GoogleCodeExporter commented 9 years ago
more from volunteermatch:

There is a problem with the character encoding of this attribute.   help    
skills:\nThe ideal candidate should be an enthusiastic team player able to work 
effectively with both leadership and donors. Candidate should have: Superior 
verbal 
and written communication skills ·Excellent 
organizational and 
planning skills ·Strong sense of personal 
integrity 
·Sincere desire to help homeless and street 
kids Time Commitment: At 
least four hours per week to dedicate to fulfilling leadership duties 
·At least six months commitment to the 
organization\n
4379
There is a problem with the character encoding of this attribute.   help    
description:\nThe Director of Fund Development for STANDUP FOR KIDS will work 
in 
cooperation with other members of the leadership team to determine the 
financial 
needs of the organization. He/she will lead the effort in the identification of 
appropriate sources of funding and will execute strategies to secure needed 
funding. 
Specific responsibilities include: Developing and maintaining a program budget 
·Help lead the creation of a Fundraising Plan 
·Execute the Fundraising 
Plan ·Grant writing ·Planning and 
coordinating fundraising events 
·Maintaining a fundraising database\n
4379
There is a problem with the character encoding of this attribute.   help    
skills:\nThe ideal candidate should be an enthusiastic team player able to work 
effectively with both leadership and volunteers. Candidate should have: 
Director of 
Support: Strong leadership ability 
�ƒ�ƒ�‚�ƒ�ƒ�‚�‚��
�‚�ƒ�ƒ�‚�‚�ƒ�‚�‚·
Ability 
to plan and manage work with minimum direction Director of Support & Assistant 
Director of Support: Superior verbal and written communication skills. 
Excellent 
organizational and planning skills. Strong sense of personal integrity. Sincere 
desire to help homeless and street kids Time Commitment: At least four hours 
per week 
to dedicate to fulfilling leadership duties. At least six months commitment to 
the 
organization \n
3780
There is a problem with the character encoding of this attribute.   help    
description:\nVolunteers are at the core of how RMHC provides assistance for 
seriously ill children and their families. As a volunteer, you may help RMHC in 
many 
remarkable ways (see below). By contributing your time as a volunteer, you will 
be 
making a big difference in the lives of many families during a time when they 
need 
support the most. Office Volunteers Assist with daily office operations, which 
may 
include computer work and filing. Green Thumb Volunteers Do you enjoy working 
with 
your hands? Help to ensure that House grounds are always looking healthy and 
beautiful. Newsletter Volunteers Help produce aspects of the newsletter or 
assist 
with its folding and mailing. House Cleaner Volunteers Help to ensure that our 
premises are always healthy environments for families. Family Driver Volunteers 
Help 
get families to and from the hospital, take them grocery shopping or on special 
outings. Extra Hand Volunteers Help around the House with all the 
“extras† 
that need to be done. Fundraising Volunteers Help with fundraising projects and 
events. Bake Night Volunteers Help children bake all kinds of goodies such as 
cookies, cakes, brownies and breads. Arts & Crafts Volunteers Want to bring 
your 
creative touch to the House? Help kids of all ages make anything from a paper 
plate 
mask to a Popsicle stick birdhouse. Special Events Volunteers Energetic and 
outgoing 
individuals are needed to participate in on-call activities, such as the annual 
RMHC 
Golf Classic. Sunday Night Dinner Club Do you enjoy cooking? Help provide a 
nutritious and memorable Sunday dinner for families. RMH Family Room Volunteers 
Help 
staff the RMH Family Room, inside Kapiolani Medical Center for Women and 
Children. 
Work directly with families that are seeking a place to “get 
away†, a place 
to gather strength and support in a homey, comfortable setting. To become an 
RMHC 
Volunteer or to request additional information, contact Michael Ahakuelo, RMHC 
Volunteer Coordinator by calling (808) 973-5683 ext. 241 or 
michaelrmhc@hawaii.rr.com. \n
372
There is a problem with the character encoding of this attribute.   help    
skills:\nThe ideal candidate should be an enthusiastic team player able to work 
effectively with both leadership and volunteers. Candidate should have: Strong 
leadership ability Ability to plan and manage work with minimum direction 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Supe
rior verbal communication skills 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Exce
llent organizational and planning skills 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Stro
ng sense of personal integrity 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Sinc
ere desire to help homeless and street kids. 
\n
3664
There is a problem with the character encoding of this attribute.   help    
skills:\nThe ideal candidate should be an enthusiastic team player able to work 
effectively with both leadership and volunteers. Candidate should have: 
Director of 
Marketing: Strong leadership ability 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Abil
ity to 
plan and manage work with minimum direction Director of Marketing & Assistant 
Director of Marketing: Superior verbal and written communication skills 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Exce
llent organizational and planning skills 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Stro
ng sense of personal integrity 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Sinc
ere desire to help homeless and street kids 
Time Commitment: At least four hours per week to dedicate to fulfilling 
leadership 
duties 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·At 
least six months commitment to the 
organization \n
3663
There is a problem with the character encoding of this attribute.   help    
description:\nThe Director of Marketing for STANDUP FOR KIDS will work in 
cooperation 
with other members of the leadership team to determine the marketing, 
communication 
and PR needs of the organization. He/she will create and execute a marketing 
plan to 
inform and educate the community about STANDUP FOR KIDS. The Assistant Director 
of 
Marketing will work under the direction of the Director of Marketing to develop 
and 
maintain a strong marketing program. Specific responsibilities of both 
positions 
include: Defining marketing goals and strategies 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Deve
loping a marketing plan 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Crea
ting presentations for various community 
groups 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Writ
ing articles and/or press releases 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Crea
ting and maintaining a marketing calendar 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Coor
dinating marketing events 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Eval
uating marketing effectiveness \n
3663
There is a problem with the character encoding of this attribute.   help    
skills:\nThe ideal candidate should be an enthusiastic team player able to work 
effectively with both leadership and donors. Candidate should have: Superior 
verbal 
and written communication skills ·Excellent 
organizational and 
planning skills ·Strong sense of personal 
integrity 
·Sincere desire to help homeless and street 
kids Time Commitment: At 
least four hours per week to dedicate to fulfilling leadership duties 
·At least six months commitment to the 
organization\n
4386
There is a problem with the character encoding of this attribute.   help    
description:\nThe Director of Fund Development for STANDUP FOR KIDS will work 
in 
cooperation with other members of the leadership team to determine the 
financial 
needs of the organization. He/she will lead the effort in the identification of 
appropriate sources of funding and will execute strategies to secure needed 
funding. 
Specific responsibilities include: Developing and maintaining a program budget 
·Help lead the creation of a Fundraising 
Plan ·Execute 
the The Director of Fund Development for STANDUP FOR KIDS will work in 
cooperation 
with other members of the leadership team to determine the financial needs of 
the 
organization. He/she will lead the effort in the identification of appropriate 
sources of funding and will execute strategies to secure needed funding. 
Specific 
responsibilities include: Developing and maintaining a program budget 
·Help lead the creation of a Fundraising 
Plan ·Execute 
the Fundraising Plan ·Grant writing 
·Planning and 
coordinating fundraising events ·Maintaining 
a fundraising database\n
4386
There is a problem with the character encoding of this attribute.   help    
skills:\nThe ideal candidate should be an enthusiastic team player able to work 
effectively with both leadership and donors. Candidate should have: 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Supe
rior verbal and written communication skills 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Exce
llent organizational and planning skills 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Stro
ng sense of personal integrity 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Sinc
ere desire to help homeless and street kids 
Time Commitment: At least four hours per week to dedicate to fulfilling 
leadership 
duties 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·At 
least six months commitment to the 
organization \n
3662
There is a problem with the character encoding of this attribute.   help    
description:\nThe Director of Fund Development for STANDUP FOR KIDS will work 
in 
cooperation with other members of the leadership team to determine the 
financial 
needs of the organization. He/she will lead the effort in the identification of 
appropriate sources of funding and will execute strategies to secure needed 
funding. 
Specific responsibilities include: Developing and maintaining a program budget 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Help
 lead the creation of a Fundraising Plan 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Exec
ute the Fundraising Plan 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Gran
t writing 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Plan
ning and coordinating fundraising events 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Main
taining a fundraising database \n
3662
There is a problem with the character encoding of this attribute.   help    
skills:\nThe ideal candidate should be an enthusiastic team player able to work 
effectively with both leadership and volunteers. Candidate should have: 
Director of 
Support: Strong leadership ability 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Abil
ity to 
plan and manage work with minimum direction Director of Support & Assistant 
Director 
of Support: Superior verbal and written communication skills 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Exce
llent organizational and planning skills 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Stro
ng sense of personal integrity 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·Sinc
ere desire to help homeless and street kids 
Time Commitment: 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·At 
least four hours per week to 
dedicate to fulfilling leadership duties 
�ƒ�ƒ�‚�‚�ƒ�‚�‚·At 
least 
six months commitment to the organization \n

Original comment by adam.sah on 4 Mar 2009 at 2:04

GoogleCodeExporter commented 9 years ago
Blake-- is this still happening?

Original comment by adam.sah on 10 Apr 2009 at 9:55

GoogleCodeExporter commented 9 years ago
Yes. Is this something I should be fixing in the parser or something you want 
to try
to identify in the TestAPI?

Original comment by blake.sc...@gmail.com on 10 Apr 2009 at 10:56

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 12 May 2009 at 3:11

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 16 May 2009 at 7:34

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 16 May 2009 at 7:41

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 17 May 2009 at 12:07

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 20 May 2009 at 5:14

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 26 May 2009 at 5:28

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 26 May 2009 at 7:49

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 5 Jun 2009 at 2:45

GoogleCodeExporter commented 9 years ago
sigh this is real:

datahub$ for f in *1.gz; do echo $f; gunzip -c $f | perl -ne '$lineno++;
s/[\t[:print:]]//g; next if $_ eq "\n";print "$lineno: $_";'|head;done
americansolutions1.gz
americorps1.gz
craigslist1.gz
extraordinaries1.gz
gspreadsheet1.gz
gspreadsheets1.gz
habitat1.gz
handsonnetwork1.gz
2275: ã
idealist1.gz
5554: á
meetup1.gz
mlk_day1.gz
mybarackobama1.gz
servenet1.gz
33723: é
unitedway1.gz
volunteer.gov1.gz
39:   
311: ¾¾
333: ïï
345:       
446: ½
468: ½
577:   
581: ····
598: ©
599: ©
volunteergov1.gz
39:   
311: ¾¾
333: ïï
345:       
446: ½
468: ½
577:   
581: ····
598: ©
599: ©

Original comment by adam.sah on 11 Jun 2009 at 2:28

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 17 Jun 2009 at 6:52

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 25 Jun 2009 at 6:01

GoogleCodeExporter commented 9 years ago

Original comment by adam.sah on 15 Jul 2009 at 6:25

GoogleCodeExporter commented 9 years ago
Moving issues that we likely won't have time for by 1.7 to 1.8 - feel free
to move back if any are being actively worked on.

Original comment by ehysen on 12 Aug 2009 at 7:02

GoogleCodeExporter commented 9 years ago
moving to v1.9

Original comment by adam.sah on 12 Nov 2009 at 3:03

GoogleCodeExporter commented 9 years ago
Comment from Adam Sah 11/12/09: Real need is to create (several) test feeds and
'attack' the pipeline to seeif you can get bad encoding chars through.  right 
behind
this, try sending encoded HTML.

Original comment by fionasch...@gmail.com on 20 Nov 2009 at 4:04

GoogleCodeExporter commented 9 years ago
Issue 549 has been merged into this issue.

Original comment by adam.sah on 20 Nov 2009 at 11:59

GoogleCodeExporter commented 9 years ago

Original comment by danstryk...@gmail.com on 8 Jan 2011 at 1:09