graatje / highscoresbot

MIT License
0 stars 1 forks source link

Forumscraping #26

Open graatje opened 1 year ago

graatje commented 1 year ago

Description

It must be possible to browse through the forums via the discord bot. The user can browse through the available boards (next/previous button), upon clicking those buttons the view will get edited and the user gets a dropdown of the 25 last updated topics of that board. When the user selects one of these topics then the topic will be showed. Work out what's possible, show multiple messages of that topic or just 1 and next/previous messages?

Implementation

Webscraper

A webscraper for the forums should be made. All topics fall under boards. This board should be a model, but new boards do not need to be dynamically detected. Those can be manually inserted since new boards almost never appear. A board model could have the following fields:

- id
- title

All the topics should be stored in a model. This model could have the following fields:

- Id
- boardid
- Title
- Author
- Created_at (default null cause this isn't present in the overview)
- Updated_at (this is the date the last message was posted/updated, this is present in the overview and is required)

There should also be a model called forummessage. This represents the messages on topics. This message has the following fields:

- id (this is present on the html)
- Topicid
- Content
- Author
- created_at
- updated_at