Open tangledhelix opened 6 months ago
pgdp_login()
can likely be replaced by a function to create an HTTP session to the API
scrape_project_info()
. Currently it is responsible to grab:
download_text()
, download_images()
and see if API replacements existGET /projects/{projectID}
will supply:
title
author
comments
which could be interpolated into README.md during renderingI don't see the forum link in the output. No other API calls seem like they'd have it either.
I see no API calls that could fetch the text or image files.
Does the API key let you into the web site as well or only into the API methods?
Auth is via a header X-API-KEY
with a value of the key.
Implemented the API in make_project.py to fetch the title, author, comments. Still need to scrape to get the forum link. Added project comments, previously this was done by hand.
Nothing else to do here unless/until the upstream API has the forum_link as well.
Particularly in
make_project.py
, anywhere that an HTML fetch & parse is happening, try to use the REST API instead.