issues
search
NIAEFEUP
/
uporto-schedule-scrapper
Python solution to extract the courses schedules from the different faculties of UPorto. Used to feed our timetable selection platform for students, TTS.
GNU General Public License v3.0
4
stars
1
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Scrape teacher sigarra url
#120
tomaspalma
opened
1 month ago
1
Add the professor's sigarra link to the professor table and change the schema
#119
tomaspalma
opened
1 month ago
0
SQL dump now has column names and fixed cases where `professor_id` was NULL
#118
tomaspalma
closed
1 month ago
0
Remove statistics
#117
thePeras
closed
1 month ago
0
Auto detect scrapper year
#116
tomaspalma
closed
1 month ago
0
feat : added hash to course_unit
#115
jose-carlos-sousa
closed
1 month ago
0
Add hash to the `CourseUnit` table
#114
tomaspalma
closed
1 month ago
0
refactor: class and slot relation is now many to many
#113
tomaspalma
closed
2 months ago
0
Refactor slot and professors spiders in light of sigarra schedule html page changes
#112
tomaspalma
closed
2 months ago
0
Make the scrapper spiders extend a class which has common methods
#111
tomaspalma
opened
3 months ago
0
Refactor slot and professor spiders due to changes to sigarra HTML
#110
tomaspalma
closed
2 months ago
0
Feat/schedule blocks 2
#109
Wallen-Ribeiro
closed
3 months ago
0
Extract slots for classes that only start at mid semester
#108
diogotvf7
closed
3 months ago
1
Refactor/states refactor
#107
diogotvf7
closed
6 months ago
1
Fix course unit schema
#106
Process-ing
closed
2 weeks ago
1
fix: documentation now reflects new .env file
#105
tomaspalma
closed
8 months ago
0
New info table
#104
diogotvf7
closed
8 months ago
0
Saving the date of the scrape
#103
diogotvf7
closed
8 months ago
0
refactor: spiders able to read os env vars
#102
tomaspalma
closed
8 months ago
0
Remove Scrapy scheduler fix
#101
LuisDuarte1
opened
8 months ago
2
Refactor/switch year password user to env file
#100
tomaspalma
closed
8 months ago
2
Fix bug where shared course units wouldn't show up
#99
LuisDuarte1
closed
8 months ago
0
Fix course metadata logic and fix convert to mysql
#98
LuisDuarte1
closed
8 months ago
0
Make scrapper config (YEAR, USER, PASSWORD) using environment variables.
#97
LuisDuarte1
closed
8 months ago
0
Fix scrapy dependencies
#96
LuisDuarte1
closed
1 year ago
0
Fix the scrapper to return the populate without ""
#95
SergioEstevao11
opened
1 year ago
0
Add english scrapping
#94
SergioEstevao11
opened
1 year ago
0
Fix shedule professor spyder
#93
Process-ing
closed
1 year ago
0
Fix schema to retrieve professors database
#92
Jumaruba
closed
1 year ago
0
Hotfix on schema
#91
Jumaruba
closed
1 year ago
0
Update Mysql schema to support professor's and renaming
#90
Jumaruba
closed
1 year ago
0
Create a script to run the scrapper periodically
#89
Jumaruba
closed
2 months ago
1
84 database schema
#88
Wallen-Ribeiro
closed
1 year ago
1
Fix script dump.py
#87
SergioEstevao11
closed
1 year ago
0
Remove unneeded scrapper sql columns
#86
SergioEstevao11
closed
1 year ago
0
Scrappy professors information
#85
diogotvf7
closed
1 year ago
0
Update Schema
#84
SergioEstevao11
closed
1 year ago
0
Updated course_units_year spider to scrape ects
#83
diogotvf7
closed
1 year ago
0
Update readme and requirements
#82
diogotvf7
closed
1 year ago
0
Update README and requirements.txt
#81
diogotvf7
closed
1 year ago
0
Scrappe information about course units' ECTs
#80
SergioEstevao11
closed
1 year ago
0
Fix schema
#79
Jumaruba
closed
1 year ago
1
build(deps): bump cryptography from 38.0.3 to 39.0.1
#78
dependabot[bot]
closed
1 year ago
1
build(deps): bump cryptography from 38.0.3 to 39.0.1 in /src
#77
dependabot[bot]
closed
1 year ago
1
build(deps): bump oauthlib from 3.2.0 to 3.2.2 in /src
#76
dependabot[bot]
closed
1 year ago
1
build(deps): bump oauthlib from 3.2.0 to 3.2.2
#75
dependabot[bot]
closed
1 year ago
1
build(deps): bump protobuf from 3.12.4 to 3.18.3 in /src
#74
dependabot[bot]
closed
1 year ago
1
build(deps): bump numpy from 1.21.5 to 1.22.0 in /src
#73
dependabot[bot]
closed
1 year ago
1
build(deps): bump pillow from 9.0.1 to 9.3.0 in /src
#72
dependabot[bot]
closed
1 year ago
1
build(deps): bump lxml from 4.8.0 to 4.9.1 in /src
#71
dependabot[bot]
closed
1 year ago
1
Next