CamJak / Boss-Integrated-Scheduler

A tool to allow easier schedule creation using BOSS at LA Tech
https://boss-integrated-scheduler.vercel.app
3 stars 0 forks source link

Create a python web scraper bot to collect data from BOSS #5

Closed CamJak closed 1 year ago

CamJak commented 2 years ago

Create a bot that can:

jackjohn7 commented 2 years ago

It might be worthwhile to go through and add some type-validation for our objects. Python doesn't really support that by default, but dataclasses or models through Pydantic have some features that allow you to create a more rigid structure for object properties which might be useful for us.

https://pydantic-docs.helpmanual.io/usage/models/ <- docs for BaseModels in Pydantic(a python module)

Need to look into dataclasses and see what fits our needs best. BaseModel has some quirks. Will reply after I know more.

CamJak commented 2 years ago

Bot can grab all Subjects and Courses from BOSS, next is adding in the ability to scrape individual class data and possibly adding an output as a spreadsheet or something.

CamJak commented 2 years ago

Need to add in some cleaning to section data, but otherwise all needed scraper functionality is implemented!

jackjohn7 commented 1 year ago

Scraper gets data and outputs it to output.json