janih / boilerpipe

Boilerplate Removal and Fulltext Extraction from HTML pages
2 stars 0 forks source link

Fail to extract main content on some page, get footnote instead #77

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1. extract content from the page (in Chinese) with ArticleExtractor 
http://www.ccgp.gov.cn/cggg/zybx/zbgg/201407/t20140731_3655909.shtml

What is the expected output? What do you see instead?
Footnote is returned, instead of main content

What version of the product are you using? On what operating system?
Latest code hosted on google code, on mac os x

Please provide any additional information below.
But the web version of boilerpipe work well on this same page, what`s the 
difference between them? Is the web version is enhanced in supporting 
non-english pages? 

Original issue reported on code.google.com by talk.sm...@gmail.com on 6 Aug 2014 at 10:57