Investigate Replay Refactor Outage

kelvinkoon commented 8 months ago

Describe the issue The PS replay site has been refactored as per: https://twitter.com/PokemonShowdown/status/1721051985720565853 Replay retrieval is broken on the data pipeline. This is a result of HTML parsing being changed.

The solution is as follows:

Replace replay fetching with the new API endpoint: https://replay.pokemonshowdown.com/api/replays/search?username=cosmo%20dancer&format=&page=1
Ensure replays are reverse chronologically ordered

Acceptance Criteria

[ ] Fix replay parsing
[ ] Fix unit tests
[ ] Deploy to prod

Zarel commented 8 months ago

Were you using HTML scraping before? Our documented API for replay searches is here:

https://github.com/smogon/pokemon-showdown-client/blob/master/WEB-API.md#replay-search

kelvinkoon commented 8 months ago

Were you using HTML scraping before? Our documented API for replay searches is here:

https://github.com/smogon/pokemon-showdown-client/blob/master/WEB-API.md#replay-search

Thanks for the response! It was confirmed the API wasn't ported last night which caused some issues on our end. https://x.com/notcelsiusdeg/status/1721387903194964426?s=46

We'll keep monitoring for any issues in the near future.

StatsugiriLabs / Statsugiri

Investigate Replay Refactor Outage #334