search

kc9eye / GalnetArchive

An XML archive of Galnet and an Archiving tool.
MIT License
2 stars 0 forks source link

[Issue] Mismatched Dates #12

Closed Andrew-J-Larson closed 3 years ago

Andrew-J-Larson commented 3 years ago

I finally figured the date issue out.

The API is not wrong, and I confirmed with other 3rd party devs with their recorded rss feeds of the article posts that came out in the past.

Turns out the archive url has indeed accidentally shifted some of the official post dates.

As an example, here's an online 3rd party API that has been going for a long time collecting the articles as they come out with the correct date information for "AISLING DUVAL WEDDING CANCELLED": https://inara.cz/galaxy-galnet/?page=85

The official API matches it's date, but the archive date is incorrect, which is another reason why not to scrape the archive page.

Andrew-J-Larson commented 3 years ago

They also have all the older 3300 dated articles. I'm thinking maybe it'd be a better idea to get a download of their archive, as a start, and then use the official galnet api to add on new articles.

kc9eye commented 3 years ago

The 3300 articles are included, the dates are those given on either the official Galnet page, or corroborated from multiple sources. IMHO, the date of the article is superfluous to it's release order and the release order is correct and corroborated.

Andrew-J-Larson commented 3 years ago

@kc9eye I'm talking about dates 3301 and beyond. In the official archive, it has the dates shifted on some.

You can cross check against two user data bases that have been capturing the posts since the beginning:

Andrew-J-Larson commented 3 years ago

They both have the correct dates (as in match up with the official ED galnet API), where https://community.elitedangerous.com/galnet is wrong.