Closed sweep-ai[bot] closed 9 months ago
src/scrapo/main.py
β
Check src/scrapo/main.py with contents:
Ran GitHub Actions for d1b6e15d952dbf1cdbd082fbf549354a7a2a5c82:
src/scrapo/db_controller.py
β
Check src/scrapo/db_controller.py with contents:
Ran GitHub Actions for 6f675b56cd5433729e4c904c404fbd563567ea97:
src/scrapo/scrapper/util.py
β
Check src/scrapo/scrapper/util.py with contents:
Ran GitHub Actions for fd74d7f3110ed3583f3ea368a74a7c27fdb6cab9:
src/scrapo/bot/reddit.py
β
Check src/scrapo/bot/reddit.py with contents:
Ran GitHub Actions for 87825592de9950bc7abea95a485128705f0af124:
src/scrapo/bot/telegram.py
β
Check src/scrapo/bot/telegram.py with contents:
Ran GitHub Actions for ec5d5e5accc6d81ea02ae67970eb39b7a4f72e14:
PR Feedback (click)
Description
This pull request includes code refactoring and bug fixes. It modifies the following files:
src/scrapo/bot/reddit.py
src/scrapo/bot/telegram.py
src/scrapo/db_controller.py
src/scrapo/main.py
src/scrapo/scrapper/util.py
Summary
reddit_instance
variable insrc/scrapo/bot/reddit.py
send_messages
function topost_courses_to_subreddit
insrc/scrapo/bot/reddit.py
TELEGRAM_API_URL
variable toTELEGRAM_MESSAGE_TEMPLATE
insrc/scrapo/bot/telegram.py
prepare_message
function toprepare_telegram_messages
insrc/scrapo/bot/telegram.py
send_messages
function tosend_telegram_messages
insrc/scrapo/bot/telegram.py
add_items
function insrc/scrapo/db_controller.py
to handle executed statements and fetched rows correctlymain
function toscraping_cycle
insrc/scrapo/main.py
main_loop
function insrc/scrapo/main.py
to run the scraping cycle periodicallyget_links
function tofetch_links
insrc/scrapo/scrapper/util.py
uniform_link
function insrc/scrapo/scrapper/util.py
to convert links to lowercaseThese changes improve the code structure, fix bugs, and enhance the functionality of the application.
Fixes #3.
π Latest improvements to Sweep:
π‘ To get Sweep to edit this pull request, you can: