Write code to get author data from Papers

[diyclassics]

Need to write code that...

• requests xml from a specific paper
• parses xml to retrieve 'creator' metadata

Then code that...

• loops through all papers
• collects creator information as a list of lists
• sends list to a page using render_template

[FMezard]

@diyclassics, I am trying to use requests-html to do so, but I have an error that I can not get past : ValueError: Unicode strings with encoding declaration are not supported. Please use bytes input or XML fragments without declaration. when trying to use it in that code :

session = HTMLSession()
    r = session.get('http://dlib.nyu.edu/awdl/isaw/isaw-papers/13/')
    print(r)
    author = r.html.absolute_links

I think that it is because there is the encoding declaration at the beginning of the file <?xml version="1.0" encoding="UTF-8"?> Can I do something about it ? Otherwise I can use BeautifulSoup since I know how to use it, but I think that you prefer html-requests.

[diyclassics]

I see that—frustrating. Let's still use requests, but parse the xml ourselves. See the following gist: https://gist.github.com/diyclassics/feb754ceb982d85a272248692e92405d. (Btw you may need to install requests and lxml.)