search

Gigahawk / canvas-file-scraper

Python script to scrape files from Canvas
GNU General Public License v3.0
15 stars 10 forks source link

Last working Version #4

Open efanibi25 opened 2 years ago

efanibi25 commented 2 years ago

4b007a6 is the last version I could get working. Not really sure why, but some of the later version just open the debugger or crash

Gigahawk commented 2 years ago

The debugger is intentionally triggered for cases that I haven't encountered yet or haven't had the time to implement

Newer versions support more canvas features so you're more likely to come across stuff that's unimplemented.

If you're not interested in implementing them yourself feel free to just delete the debugger calls.

efanibi25 commented 2 years ago

canvas.oregonstate.edu [INFO ][main] Starting scrape [INFO ][main.course_1810910] ANALYSIS OF ALGORITHMS (CS_325_400_S2021) [INFO ][main.course_1810910.module_2672377] Start Here [INFO ][main.course_1810910.module_2672377.item_20787133] Start Here - Overview [INFO ][main.course_1810910.module_2672377.item_20787135] Start Here - Syllabus [INFO ][main.course_1810910.module_2672377.item_20787153] Start Here - Microsoft Teams and Ed Discussions [INFO ][main.course_1810910.module_2672377.item_20787141] Start Here - Where to go for help [INFO ][main.course_1810910.module_2672377.item_20787139] Start Here - Academic Misconduct [INFO ][main.course_1810910.module_2672377.item_20787143] Start Here - ReadSpeaker TextAid [WARNI][main.course_1810910.module_2672377.item_20787143] Unsupported type ExternalTool

/home/john/src/canvis_scraper/canvas_file_scraper/scraper.py(185)recurse_item() -> self.pop() (Pdb)

Two theories I have are

  1. Python Version and maybe some of the package verison I have downloaded
  2. Maybe something to do with how my university has canvas setup.
Gigahawk commented 2 years ago

External tools are currently unsupported.

Last year my school went online and integrated Zoom into canvas and I was looking into being able to scrape the recordings.

It wasn't worth the effort so it's just left unimplemented, you can just remove the debugger call if you want

Alternatively since it looks like you're seeing this in a module item you can just add another check for external tools that doesn't do anything, right now theres a check for subheadings that doesn't do anything.