search

LLNL / scraper

Python library for getting metadata from source code hosting tools
MIT License
49 stars 23 forks source link

Add the ability to configure GitHub session timeouts #71

Closed mcdonnnj closed 1 year ago

mcdonnnj commented 1 year ago

Description

This pull request adds the ability to configure the connect and read timeouts in a github3.py GitHub session.

Motivation

I ran into an issue where partway through processing our org the scrape would fail due to a github3.exceptions.ConnectionError exception caused by a requests.exceptions.ReadTimeout exception. After implementing these changes I tried again after changing the read timeout to 15 (default is 10) and it was able to run to completion.

⚠ Testing Note

This pull request needs the changes in #72 to pass tests.