janih / boilerpipe

Boilerplate Removal and Fulltext Extraction from HTML pages
2 stars 0 forks source link

Boilerpipe is conflicting with CyberNeko library #81

Open GoogleCodeExporter opened 9 years ago

GoogleCodeExporter commented 9 years ago
What steps will reproduce the problem?
1. if boilerpipe is at a higher precedence than CyberNeko library, then it will 
cause parsing issue on user input with unbalanced tags
2.
3.

What is the expected output? What do you see instead?
Given this unbalanced HTML input 
{"$version":"<maven>project.version</maven>","pmg":false,"list":[null],"entityLi
st":[]}, CyberNeko should return the correct DOM tree
Child 1: [#text: {"$version":"]
Child 2: [maven: null]
Child 3: [#text: ","pmg":false,"list":[null],"entityList":[]}]

However, after having boilerpipe jar libray placed at a higher precedence, it 
will produce the following wrong results
Child 1: [#text: {"$version":"]
Child 2: [html: null]
Child 3: [body: null]

The root cause is the boilerpipe has copied HTMLElements and HTMLTagBalancer 
from CyberNeko. Please remove these 2 classes from boilerpipe jar

Additional information can be found at this blog (written in simplified 
chinese) 
http://sandomingo.github.io/blog/2014/04/26/duplicate-class-in-different-jar/

What version of the product are you using? On what operating system?

Please provide any additional information below.

Original issue reported on code.google.com by jacky...@gmail.com on 28 Oct 2014 at 6:09

GoogleCodeExporter commented 9 years ago
Duplicate of https://code.google.com/p/boilerpipe/issues/detail?id=62

Original comment by benjamin...@gmail.com on 19 Nov 2014 at 9:38