Feedback on Wiley parser

CederGroupHub / LimeSoup

LimeSoup is a package to parse HTML or XML papers from different publishers.

MIT License

19 stars 7 forks source link

Feedback on Wiley parser #22

Closed hhaoyan closed 5 years ago

hhaoyan commented 5 years ago

Here is a list of issues found for the Wiley parser:

[x] References are not removed from paragraphs.
[x] Duplicates of paragraphs: for example https://doi.org/10.1111/j.1551-2916.2011.04722.x
[x] Some paragraphs don't have a section name for example 10.1002/anie.201305377.
[x] missing paragraphs for example 10.1111/jace.12629, 10.1002/adma.201103895.
[x] Subsection names are not parsed: 10.1002/2017JE005343

Issue 2 is the most urgent one.

eddotman commented 5 years ago

We found that some Wiley papers don't have any section names at all. Is there a preferred behavior / output for when no section name exists?

zjensen262 commented 5 years ago

What is the desired output when a paper does not have a section structure. For example, this paper here https://doi.org/10.1002/anie.201508702. These papers also don't use the standard tags since there are no headers.

zjensen262 commented 5 years ago

@hhaoyan could you address the above comments. Sorry forgot to link anyone in on this.

hhaoyan commented 5 years ago

Sorry for the late reply... For sections without a title, I think we can leave it as empty?