KeyError: 'content_type'

[dharrisvelaro]

I'm getting a KeyError error after about 30 mins into the scrape. It happens every run. Processing doesn't finish.

Traceback (most recent call last): File "G:\Temp\UltimaScraper\start_us.py", line 62, in asyncio.run(main()) File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python311\Lib\asyncio\runners.py", line 190, in run return runner.run(main) ^^^^^^^^^^^^^^^^ File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python311\Lib\asyncio\runners.py", line 118, in run return self._loop.run_until_complete(task) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\XXXXX\AppData\Local\Programs\Python\Python311\Lib\asyncio\base_events.py", line 653, in run_until_complete return future.result() ^^^^^^^^^^^^^^^ File "G:\Temp\UltimaScraper\start_us.py", line 44, in main _api = await USR.start( ^^^^^^^^^^^^^^^^ File "G:\Temp\UltimaScraper\ultima_scraper\ultima_scraper.py", line 50, in start await self.start_datascraper(datascraper) File "G:\Temp\UltimaScraper\ultima_scraper\ultima_scraper.py", line 115, in start_datascraper await self.assign_jobs(final_job_user_list) File "G:\Temp\UltimaScraper\ultima_scraper\ultima_scraper.py", line 174, in assign_jobs await metadata_manager.process_legacy_metadata() File "C:\Users\XXXXX\AppData\Local\pypoetry\Cache\virtualenvs\ultima-scraper-FCxyvvLr-py3.11\Lib\site-packages\ultima_scraper_collection\managers\metadata_manager\metadata_manager.py", line 318, in process_legacy_metadata self.fix_json() File "C:\Users\XXXXX\AppData\Local\pypoetry\Cache\virtualenvs\ultima-scraper-FCxyvvLr-py3.11\Lib\site-packages\ultima_scraper_collection\managers\metadata_manager\metadata_manager.py", line 384, in fix_json final_content_type = new_metadata_set["content_type"]

KeyError: 'content_type'