search

FirstStreet / fsf_api_access_python

First Street API Access (Python)
https://firststreet.org/
MIT License
13 stars 7 forks source link

Rate Limit Error due to Session is Closed #49

Closed Lyetenth closed 3 years ago

Lyetenth commented 3 years ago

From @rcoskrey:

With a rate_period of 60 and rate_limit of 5000, user receives a RateLimitError: Network Error 429. Problem persists even after changing the rate_period, rate_limit, and connection_limits.

Changing the connection limit to 200, however allowed 7500/100000 pulls before the same Rate Limit Error.

Additional Information: Python Version: 3.X

Fsf-api-access-python Version: 2.3.2

Lyetenth commented 3 years ago

@rcoskrey, could you also provide your code and response?

rcoskrey commented 3 years ago

firststreet.FirstStreet( "key", connection_limit=200, rate_limit=5000, rate_period=60, log=True )

location_summary = fs.location.get_summary(search_items="fsids_100k.csv", location_type="property", csv=True) 0%| | 0/99999 [00:00<?, ?it/s] 0%| | 1/99999 [00:05<145:03:02, 5.22s/it] 0%| | 20/99999 [00:05<5:17:43, 5.24it/s] 0%| | 33/99999 [00:05<2:52:17, 9.67it/s] 0%| | 76/99999 [00:05<55:00, 30.27it/s]
0%| | 130/99999 [00:05<26:13, 63.49it/s] 0%| | 185/99999 [00:05<15:57, 104.22it/s] 0%| | 226/99999 [00:05<12:17, 135.34it/s] 0%| | 271/99999 [00:05<09:28, 175.49it/s] 0%| | 311/99999 [00:06<08:02, 206.80it/s] 0%| | 350/99999 [00:06<07:43, 214.99it/s] 0%| | 390/99999 [00:06<06:41, 247.87it/s] 0%| | 426/99999 [00:06<06:46, 244.72it/s] 0%| | 458/99999 [00:06<06:28, 256.07it/s] 0%| | 490/99999 [00:06<06:34, 252.21it/s] 1%| | 524/99999 [00:06<06:28, 256.09it/s] 1%| | 553/99999 [00:07<06:23, 259.22it/s] 1%| | 594/99999 [00:07<05:42, 290.31it/s] 1%| | 625/99999 [00:07<05:43, 289.22it/s] 1%| | 657/99999 [00:07<05:40, 291.79it/s] 1%| | 690/99999 [00:07<05:38, 293.21it/s] 1%| | 720/99999 [00:07<06:00, 275.15it/s] 1%| | 751/99999 [00:07<05:51, 281.97it/s] 1%| | 792/99999 [00:07<05:19, 310.96it/s] 1%| | 876/99999 [00:07<03:37, 454.91it/s] 1%| | 937/99999 [00:07<03:18, 498.02it/s] 1%| | 988/99999 [00:08<03:21, 490.71it/s] 1%| | 1038/99999 [00:08<03:39, 450.23it/s] 1%| | 1087/99999 [00:08<03:34, 460.12it/s] 1%| | 1134/99999 [00:08<04:02, 408.19it/s] 1%| | 1177/99999 [00:08<04:06, 401.59it/s] 1%| | 1221/99999 [00:08<04:01, 408.18it/s] 1%|▏ | 1271/99999 [00:08<03:52, 424.39it/s] 1%|▏ | 1316/99999 [00:08<03:49, 430.50it/s] 1%|▏ | 1360/99999 [00:09<08:36, 191.05it/s] 1%|▏ | 1397/99999 [00:09<11:39, 140.96it/s] 1%|▏ | 1423/99999 [00:10<16:55, 97.06it/s] 1%|▏ | 1480/99999 [00:11<17:49, 92.11it/s] 1%|▏ | 1496/99999 [00:11<26:09, 62.75it/s] 2%|▏ | 1568/99999 [00:12<21:42, 75.56it/s] 2%|▏ | 1588/99999 [00:12<22:02, 74.44it/s] 2%|▏ | 1680/99999 [00:13<11:50, 138.46it/s] 2%|▏ | 1717/99999 [00:13<10:10, 160.98it/s] 2%|▏ | 1751/99999 [00:13<09:14, 177.11it/s] 2%|▏ | 1802/99999 [00:13<07:20, 222.78it/s] 2%|▏ | 1843/99999 [00:13<06:28, 252.87it/s] 2%|▏ | 1897/99999 [00:13<05:21, 304.98it/s] 2%|▏ | 1939/99999 [00:13<06:08, 266.23it/s] 2%|▏ | 2007/99999 [00:13<04:42, 346.75it/s] 2%|▏ | 2052/99999 [00:14<04:30, 362.00it/s] 2%|▏ | 2096/99999 [00:14<04:41, 348.39it/s] 2%|▏ | 2144/99999 [00:14<04:20, 375.27it/s] 2%|▏ | 2186/99999 [00:14<04:27, 365.85it/s] 2%|▏ | 2226/99999 [00:14<04:40, 348.65it/s] 2%|▏ | 2279/99999 [00:14<04:10, 390.05it/s] 2%|▏ | 2326/99999 [00:14<03:58, 409.36it/s] 2%|▏ | 2369/99999 [00:14<04:26, 365.96it/s] 2%|▏ | 2417/99999 [00:14<04:07, 394.05it/s] 2%|▏ | 2459/99999 [00:15<04:16, 380.23it/s] 2%|▏ | 2499/99999 [00:15<04:13, 385.21it/s] 3%|▎ | 2539/99999 [00:15<04:22, 370.66it/s] 3%|▎ | 2577/99999 [00:15<04:39, 348.16it/s] 3%|▎ | 2613/99999 [00:15<04:41, 345.77it/s] 3%|▎ | 2655/99999 [00:15<04:29, 361.32it/s] 3%|▎ | 2699/99999 [00:15<04:16, 379.69it/s] 3%|▎ | 2738/99999 [00:15<04:17, 378.05it/s] 3%|▎ | 2823/99999 [00:15<03:09, 512.37it/s] 3%|▎ | 2876/99999 [00:16<03:14, 499.50it/s] 3%|▎ | 2927/99999 [00:16<03:40, 440.69it/s] 3%|▎ | 2979/99999 [00:16<03:37, 445.07it/s] 3%|▎ | 3025/99999 [00:16<03:36, 448.14it/s] 3%|▎ | 3071/99999 [00:16<03:38, 443.78it/s] 3%|▎ | 3116/99999 [00:16<03:40, 438.76it/s] 3%|▎ | 3168/99999 [00:16<03:30, 460.51it/s] 3%|▎ | 3215/99999 [00:16<03:45, 429.21it/s] 3%|▎ | 3264/99999 [00:16<03:38, 441.75it/s] 3%|▎ | 3309/99999 [00:17<03:41, 436.43it/s] 3%|▎ | 3353/99999 [00:17<03:41, 436.52it/s] 3%|▎ | 3397/99999 [00:17<03:48, 423.03it/s] 3%|▎ | 3440/99999 [00:17<03:52, 415.52it/s] 3%|▎ | 3489/99999 [00:17<03:43, 432.00it/s] 4%|▎ | 3533/99999 [00:17<03:50, 417.83it/s] 4%|▎ | 3575/99999 [00:17<05:00, 320.95it/s] 4%|▎ | 3624/99999 [00:17<04:30, 356.47it/s] 4%|▎ | 3726/99999 [00:18<03:04, 520.63it/s] 4%|▍ | 3784/99999 [00:18<03:05, 518.65it/s] 4%|▍ | 3840/99999 [00:18<03:11, 501.87it/s] 4%|▍ | 3893/99999 [00:18<03:11, 502.31it/s] 4%|▍ | 3946/99999 [00:18<03:12, 498.08it/s] 4%|▍ | 3998/99999 [00:18<03:11, 500.07it/s] 4%|▍ | 4049/99999 [00:18<03:15, 490.55it/s] 4%|▍ | 4107/99999 [00:18<03:08, 508.48it/s] 4%|▍ | 4159/99999 [00:18<03:39, 437.09it/s] 4%|▍ | 4222/99999 [00:19<03:18, 481.82it/s] 4%|▍ | 4273/99999 [00:19<03:25, 466.28it/s] 4%|▍ | 4322/99999 [00:19<07:08, 223.23it/s] 4%|▍ | 4415/99999 [00:20<08:03, 197.67it/s] 4%|▍ | 4446/99999 [00:20<11:53, 133.93it/s] 5%|▍ | 4526/99999 [00:21<12:10, 130.71it/s] 5%|▍ | 4546/99999 [00:22<20:58, 75.87it/s] 5%|▍ | 4580/99999 [00:23<23:26, 67.84it/s] 5%|▍ | 4657/99999 [00:23<14:23, 110.43it/s] 5%|▍ | 4689/99999 [00:23<13:03, 121.66it/s] 5%|▍ | 4732/99999 [00:23<10:28, 151.55it/s] 5%|▍ | 4765/99999 [00:23<09:23, 168.96it/s] 5%|▍ | 4810/99999 [00:23<07:43, 205.26it/s] 5%|▍ | 4844/99999 [00:23<07:32, 210.16it/s] 5%|▍ | 4874/99999 [00:24<07:13, 219.41it/s] 5%|▍ | 4910/99999 [00:24<06:29, 244.26it/s] 5%|▍ | 4941/99999 [00:24<06:28, 244.91it/s] 5%|▍ | 4977/99999 [00:24<05:52, 269.91it/s] 5%|▌ | 5009/99999 [00:24<05:41, 278.44it/s] 5%|▌ | 5049/99999 [00:24<05:07, 308.45it/s] 5%|▌ | 5083/99999 [00:24<05:15, 300.67it/s] 5%|▌ | 5125/99999 [00:24<04:45, 332.35it/s] 5%|▌ | 5160/99999 [00:25<05:07, 308.07it/s] 5%|▌ | 5201/99999 [00:25<04:43, 334.74it/s] 5%|▌ | 5236/99999 [00:25<04:53, 322.45it/s] 5%|▌ | 5271/99999 [00:25<04:49, 326.98it/s] 5%|▌ | 5305/99999 [00:25<05:13, 302.09it/s] 5%|▌ | 5336/99999 [00:25<06:18, 250.07it/s] 5%|▌ | 5388/99999 [00:25<05:03, 312.21it/s] 5%|▌ | 5422/99999 [00:25<05:05, 309.83it/s] 5%|▌ | 5457/99999 [00:25<05:14, 300.50it/s] 5%|▌ | 5497/99999 [00:26<04:53, 322.03it/s] 6%|▌ | 5541/99999 [00:26<04:30, 349.04it/s] 6%|▌ | 5577/99999 [00:26<04:34, 343.61it/s] 6%|▌ | 5627/99999 [00:26<04:04, 386.74it/s] 6%|▌ | 5667/99999 [00:26<04:12, 372.98it/s] 6%|▌ | 5710/99999 [00:26<04:04, 385.43it/s] 6%|▌ | 5765/99999 [00:26<03:44, 419.56it/s] 6%|▌ | 5847/99999 [00:26<02:58, 527.66it/s] 6%|▌ | 5912/99999 [00:26<02:48, 559.32it/s] 6%|▌ | 5969/99999 [00:27<02:55, 536.39it/s] 6%|▌ | 6024/99999 [00:27<04:50, 323.30it/s] 6%|▌ | 6100/99999 [00:27<03:51, 406.35it/s] 6%|▌ | 6162/99999 [00:27<03:27, 452.03it/s] 6%|▌ | 6218/99999 [00:27<03:27, 451.41it/s] 6%|▋ | 6271/99999 [00:27<03:23, 460.99it/s] 6%|▋ | 6323/99999 [00:27<03:30, 445.71it/s] 6%|▋ | 6372/99999 [00:28<03:33, 439.34it/s] 6%|▋ | 6434/99999 [00:28<03:14, 480.81it/s] 6%|▋ | 6485/99999 [00:28<03:16, 475.86it/s] 7%|▋ | 6535/99999 [00:28<03:25, 454.68it/s] 7%|▋ | 6600/99999 [00:28<03:11, 488.95it/s] 7%|▋ | 6650/99999 [00:28<03:15, 477.90it/s] 7%|▋ | 6716/99999 [00:28<02:58, 523.61it/s] 7%|▋ | 6770/99999 [00:28<03:04, 505.86it/s] 7%|▋ | 6829/99999 [00:28<02:56, 527.26it/s] 7%|▋ | 6884/99999 [00:29<02:55, 531.68it/s] 7%|▋ | 6938/99999 [00:29<02:57, 524.32it/s] 7%|▋ | 6996/99999 [00:29<02:54, 534.16it/s] 7%|▋ | 7050/99999 [00:29<02:53, 535.40it/s] 7%|▋ | 7104/99999 [00:30<09:27, 163.82it/s] 7%|▋ | 7185/99999 [00:30<11:08, 138.78it/s] 7%|▋ | 7285/99999 [00:31<09:48, 157.45it/s] 7%|▋ | 7339/99999 [00:32<12:01, 128.35it/s] 7%|▋ | 7402/99999 [00:32<13:44, 112.32it/s] 7%|▋ | 7439/99999 [00:33<16:58, 90.89it/s]

RateLimitError Traceback (most recent call last)

in ----> 1 location_summary = fs.location.get_summary(search_items="fsids_100k.csv", location_type="property", csv=True) ~/opt/anaconda3/lib/python3.8/site-packages/firststreet/api/location.py in get_summary(self, search_items, location_type, csv, output_dir, extra_param) 108 109 # Get data from api and create objects --> 110 api_datas = self.call_api(search_items, "location", "summary", location_type, extra_param=extra_param) 111 112 if location_type == "property": ~/opt/anaconda3/lib/python3.8/site-packages/firststreet/api/api.py in call_api(self, search_item, product, product_subtype, location, tile_product, year, return_period, event_id, extra_param) 129 # Asynchronously call the API for each endpoint 130 loop = asyncio.get_event_loop() --> 131 response = loop.run_until_complete(self._http.endpoint_execute(endpoints)) 132 133 return response ~/opt/anaconda3/lib/python3.8/site-packages/nest_asyncio.py in run_until_complete(self, future) 68 raise RuntimeError( 69 'Event loop stopped before Future completed.') ---> 70 return f.result() 71 72 def _run_once(self): ~/opt/anaconda3/lib/python3.8/asyncio/futures.py in result(self) 176 self.__log_traceback = False 177 if self._exception is not None: --> 178 raise self._exception 179 return self._result 180 ~/opt/anaconda3/lib/python3.8/asyncio/tasks.py in __step(***failed resolving arguments***) 278 # We use the `send` method directly, because coroutines 279 # don't have `__iter__` and `__next__` methods. --> 280 result = coro.send(None) 281 else: 282 result = coro.throw(exc) ~/opt/anaconda3/lib/python3.8/site-packages/firststreet/http_util.py in endpoint_execute(self, endpoints) 83 tasks = [asyncio.create_task(self.bound_fetch(sem, endpoint, session, throttler)) for endpoint in endpoints] 84 ---> 85 [await f for f in tqdm.tqdm(asyncio.as_completed(tasks), total=len(endpoints))] 86 ret = [t.result() for t in tasks] 87 ~/opt/anaconda3/lib/python3.8/site-packages/firststreet/http_util.py in (.0) 83 tasks = [asyncio.create_task(self.bound_fetch(sem, endpoint, session, throttler)) for endpoint in endpoints] 84 ---> 85 [await f for f in tqdm.tqdm(asyncio.as_completed(tasks), total=len(endpoints))] 86 ret = [t.result() for t in tasks] 87 ~/opt/anaconda3/lib/python3.8/asyncio/tasks.py in _wait_for_one() 606 # Dummy value from _on_timeout(). 607 raise exceptions.TimeoutError --> 608 return f.result() # May raise f.exception(). 609 610 for f in todo: ~/opt/anaconda3/lib/python3.8/asyncio/futures.py in result(self) 176 self.__log_traceback = False 177 if self._exception is not None: --> 178 raise self._exception 179 return self._result 180 ~/opt/anaconda3/lib/python3.8/asyncio/tasks.py in __step(***failed resolving arguments***) 278 # We use the `send` method directly, because coroutines 279 # don't have `__iter__` and `__next__` methods. --> 280 result = coro.send(None) 281 else: 282 result = coro.throw(exc) ~/opt/anaconda3/lib/python3.8/site-packages/firststreet/http_util.py in bound_fetch(self, sem, endpoint, session, throttler) 61 async def bound_fetch(self, sem, endpoint, session, throttler): 62 async with sem: ---> 63 return await self.execute(endpoint, session, throttler) 64 65 async def endpoint_execute(self, endpoints): ~/opt/anaconda3/lib/python3.8/site-packages/firststreet/http_util.py in execute(self, endpoint, session, throttler) 121 # Read a json response 122 else: --> 123 return await self.product_response(response, endpoint) 124 125 except (asyncio.TimeoutError, JSONDecodeError) as ex: ~/opt/anaconda3/lib/python3.8/site-packages/firststreet/http_util.py in product_response(self, response, endpoint) 164 try: 165 if response.status != 200 and response.status != 404 and response.status != 500: --> 166 raise self._network_error(self.options, rate_limit, error=body.get('error')) 167 168 error = body.get("error") RateLimitError: Network Error 429: Rate limit exceeded. Limit: 5000. Remaining: 0. Reset: 43 2021-03-10 09:07:18,821 root ERROR error getting item: 90782263 from https://api.firststreet.org/v1/location/summary/property/90782263? 2021-03-10 09:07:18,830 root ERROR error getting item: 90816445 from https://api.firststreet.org/v1/location/summary/property/90816445? 2021-03-10 09:07:18,831 root ERROR error getting item: 90816272 from https://api.firststreet.org/v1/location/summary/property/90816272? 2021-03-10 09:07:18,833 root ERROR error getting item: 90797893 from https://api.firststreet.org/v1/location/summary/property/90797893? 2021-03-10 09:07:18,835 root ERROR error getting item: 90816186 from https://api.firststreet.org/v1/location/summary/property/90816186? 2021-03-10 09:07:18,836 root ERROR error getting item: 90818919 from https://api.firststreet.org/v1/location/summary/property/90818919? 2021-03-10 09:07:18,837 root ERROR error getting item: 90816275 from https://api.firststreet.org/v1/location/summary/property/90816275? 2021-03-10 09:07:18,838 root ERROR error getting item: 90782246 from https://api.firststreet.org/v1/location/summary/property/90782246? 2021-03-10 09:07:18,839 root ERROR error getting item: 90782245 from https://api.firststreet.org/v1/location/summary/property/90782245? 2021-03-10 09:07:18,840 root ERROR error getting item: 90782310 from https://api.firststreet.org/v1/location/summary/property/90782310? 2021-03-10 09:07:18,842 root ERROR error getting item: 90818542 from https://api.firststreet.org/v1/location/summary/property/90818542? 2021-03-10 09:07:18,843 root ERROR error getting item: 90818564 from https://api.firststreet.org/v1/location/summary/property/90818564? 2021-03-10 09:07:18,845 root ERROR error getting item: 90818546 from https://api.firststreet.org/v1/location/summary/property/90818546? 2021-03-10 09:07:18,846 root ERROR error getting item: 90817944 from https://api.firststreet.org/v1/location/summary/property/90817944? 2021-03-10 09:07:18,848 root ERROR error getting item: 90782198 from https://api.firststreet.org/v1/location/summary/property/90782198? 2021-03-10 09:07:18,850 root ERROR error getting item: 90817950 from https://api.firststreet.org/v1/location/summary/property/90817950? 2021-03-10 09:07:18,851 root ERROR error getting item: 90817958 from https://api.firststreet.org/v1/location/summary/property/90817958? 2021-03-10 09:07:18,853 root ERROR error getting item: 90817749 from https://api.firststreet.org/v1/location/summary/property/90817749? 2021-03-10 09:07:18,854 root ERROR error getting item: 90782207 from https://api.firststreet.org/v1/location/summary/property/90782207? 2021-03-10 09:07:18,856 root ERROR error getting item: 90782186 from https://api.firststreet.org/v1/location/summary/property/90782186? 2021-03-10 09:07:18,858 root ERROR error getting item: 90782205 from https://api.firststreet.org/v1/location/summary/property/90782205? 2021-03-10 09:07:18,859 root ERROR error getting item: 90782331 from https://api.firststreet.org/v1/location/summary/property/90782331? 2021-03-10 09:07:18,861 root ERROR error getting item: 90817507 from https://api.firststreet.org/v1/location/summary/property/90817507? 2021-03-10 09:07:18,863 root ERROR error getting item: 90817750 from https://api.firststreet.org/v1/location/summary/property/90817750? 2021-03-10 09:07:18,864 root ERROR error getting item: 90817474 from https://api.firststreet.org/v1/location/summary/property/90817474? 2021-03-10 09:07:18,866 root ERROR error getting item: 90776706 from https://api.firststreet.org/v1/location/summary/property/90776706? 2021-03-10 09:07:18,867 root ERROR error getting item: 90782200 from https://api.firststreet.org/v1/location/summary/property/90782200? 2021-03-10 09:07:18,870 root ERROR error getting item: 90782269 from https://api.firststreet.org/v1/location/summary/property/90782269? 2021-03-10 09:07:18,880 root ERROR error getting item: 90818539 from https://api.firststreet.org/v1/location/summary/property/90818539? 2021-03-10 09:07:18,885 root ERROR error getting item: 90816274 from https://api.firststreet.org/v1/location/summary/property/90816274? 2021-03-10 09:07:18,890 root ERROR error getting item: 90816271 from https://api.firststreet.org/v1/location/summary/property/90816271? 2021-03-10 09:07:18,891 root ERROR error getting item: 90816308 from https://api.firststreet.org/v1/location/summary/property/90816308? 2021-03-10 09:07:18,892 root ERROR error getting item: 90816421 from https://api.firststreet.org/v1/location/summary/property/90816421? 2021-03-10 09:07:18,894 root ERROR error getting item: 90816279 from https://api.firststreet.org/v1/location/summary/property/90816279? 2021-03-10 09:07:18,897 root ERROR error getting item: 90816310 from https://api.firststreet.org/v1/location/summary/property/90816310? 2021-03-10 09:07:18,908 root ERROR error getting item: 90817859 from https://api.firststreet.org/v1/location/summary/property/90817859? 2021-03-10 09:07:18,913 root ERROR error getting item: 90816265 from https://api.firststreet.org/v1/location/summary/property/90816265? 2021-03-10 09:07:18,936 root ERROR error getting item: 90817846 from https://api.firststreet.org/v1/location/summary/property/90817846? 2021-03-10 09:07:18,937 root ERROR error getting item: 90817839 from https://api.firststreet.org/v1/location/summary/property/90817839? 2021-03-10 09:07:18,940 root ERROR error getting item: 90797154 from https://api.firststreet.org/v1/location/summary/property/90797154? 2021-03-10 09:07:18,942 root ERROR error getting item: 90816301 from https://api.firststreet.org/v1/location/summary/property/90816301? 2021-03-10 09:07:18,947 root ERROR error getting item: 90817845 from https://api.firststreet.org/v1/location/summary/property/90817845? 2021-03-10 09:07:18,950 root ERROR error getting item: 90818570 from https://api.firststreet.org/v1/location/summary/property/90818570? 2021-03-10 09:07:18,954 root ERROR error getting item: 90797657 from https://api.firststreet.org/v1/location/summary/property/90797657? 2021-03-10 09:07:18,957 root ERROR error getting item: 90818576 from https://api.firststreet.org/v1/location/summary/property/90818576? 2021-03-10 09:07:18,959 root ERROR error getting item: 90818574 from https://api.firststreet.org/v1/location/summary/property/90818574? 2021-03-10 09:07:18,970 root ERROR error getting item: 90818591 from https://api.firststreet.org/v1/location/summary/property/90818591? 2021-03-10 09:07:18,972 root ERROR error getting item: 90818563 from https://api.firststreet.org/v1/location/summary/property/90818563? 2021-03-10 09:07:18,973 root ERROR error getting item: 90797706 from https://api.firststreet.org/v1/location/summary/property/90797706? 2021-03-10 09:07:18,979 root ERROR error getting item: 90818698 from https://api.firststreet.org/v1/location/summary/property/90818698? 2021-03-10 09:07:18,980 root ERROR error getting item: 90818588 from https://api.firststreet.org/v1/location/summary/property/90818588? 2021-03-10 09:07:18,982 root ERROR error getting item: 90797658 from https://api.firststreet.org/v1/location/summary/property/90797658? 2021-03-10 09:07:18,984 root ERROR error getting item: 90818586 from https://api.firststreet.org/v1/location/summary/property/90818586? 2021-03-10 09:07:18,987 root ERROR error getting item: 90818693 from https://api.firststreet.org/v1/location/summary/property/90818693? 2021-03-10 09:07:18,989 root ERROR error getting item: 90818750 from https://api.firststreet.org/v1/location/summary/property/90818750? 2021-03-10 09:07:18,990 root ERROR error getting item: 90818879 from https://api.firststreet.org/v1/location/summary/property/90818879? 2021-03-10 09:07:18,992 root ERROR error getting item: 90818714 from https://api.firststreet.org/v1/location/summary/property/90818714? 2021-03-10 09:07:18,993 root ERROR error getting item: 90818760 from https://api.firststreet.org/v1/location/summary/property/90818760? 2021-03-10 09:07:18,994 root ERROR error getting item: 90818707 from https://api.firststreet.org/v1/location/summary/property/90818707? 2021-03-10 09:07:18,996 root ERROR error getting item: 90818854 from https://api.firststreet.org/v1/location/summary/property/90818854? 2021-03-10 09:07:18,997 root ERROR error getting item: 90819003 from https://api.firststreet.org/v1/location/summary/property/90819003? 2021-03-10 09:07:18,999 root ERROR error getting item: 90819014 from https://api.firststreet.org/v1/location/summary/property/90819014? 2021-03-10 09:07:19,002 root ERROR error getting item: 90818883 from https://api.firststreet.org/v1/location/summary/property/90818883? 2021-03-10 09:07:19,004 root ERROR error getting item: 90818755 from https://api.firststreet.org/v1/location/summary/property/90818755? 2021-03-10 09:07:19,006 root ERROR error getting item: 90819002 from https://api.firststreet.org/v1/location/summary/property/90819002? 2021-03-10 09:07:19,010 root ERROR error getting item: 90818731 from https://api.firststreet.org/v1/location/summary/property/90818731? 2021-03-10 09:07:19,011 root ERROR error getting item: 90818884 from https://api.firststreet.org/v1/location/summary/property/90818884? 2021-03-10 09:07:19,013 root ERROR error getting item: 90818770 from https://api.firststreet.org/v1/location/summary/property/90818770? 2021-03-10 09:07:19,015 root ERROR error getting item: 90768258 from https://api.firststreet.org/v1/location/summary/property/90768258? 2021-03-10 09:07:19,017 root ERROR error getting item: 90819036 from https://api.firststreet.org/v1/location/summary/property/90819036? 2021-03-10 09:07:19,029 root ERROR error getting item: 90818856 from https://api.firststreet.org/v1/location/summary/property/90818856? 2021-03-10 09:07:19,030 root ERROR error getting item: 90768328 from https://api.firststreet.org/v1/location/summary/property/90768328? 2021-03-10 09:07:19,032 root ERROR error getting item: 90819034 from https://api.firststreet.org/v1/location/summary/property/90819034? 2021-03-10 09:07:19,035 root ERROR error getting item: 90817231 from https://api.firststreet.org/v1/location/summary/property/90817231? 2021-03-10 09:07:19,036 root ERROR error getting item: 90817082 from https://api.firststreet.org/v1/location/summary/property/90817082? 2021-03-10 09:07:19,037 root ERROR error getting item: 90768272 from https://api.firststreet.org/v1/location/summary/property/90768272? 2021-03-10 09:07:19,039 root ERROR error getting item: 90768253 from https://api.firststreet.org/v1/location/summary/property/90768253? 2021-03-10 09:07:19,042 root ERROR error getting item: 90818886 from https://api.firststreet.org/v1/location/summary/property/90818886? 2021-03-10 09:07:19,043 root ERROR error getting item: 90817073 from https://api.firststreet.org/v1/location/summary/property/90817073? 2021-03-10 09:07:19,044 root ERROR error getting item: 90819039 from https://api.firststreet.org/v1/location/summary/property/90819039? 2021-03-10 09:07:19,046 root ERROR error getting item: 90768270 from https://api.firststreet.org/v1/location/summary/property/90768270? 2021-03-10 09:07:19,048 root ERROR error getting item: 90817092 from https://api.firststreet.org/v1/location/summary/property/90817092? 2021-03-10 09:07:19,059 root ERROR error getting item: 90817093 from https://api.firststreet.org/v1/location/summary/property/90817093? 2021-03-10 09:07:19,061 root ERROR error getting item: 90817213 from https://api.firststreet.org/v1/location/summary/property/90817213? 2021-03-10 09:07:19,062 root ERROR error getting item: 90817083 from https://api.firststreet.org/v1/location/summary/property/90817083? 2021-03-10 09:07:19,063 root ERROR error getting item: 90817085 from https://api.firststreet.org/v1/location/summary/property/90817085? 2021-03-10 09:07:19,066 root ERROR error getting item: 90817086 from https://api.firststreet.org/v1/location/summary/property/90817086? 2021-03-10 09:07:19,067 root ERROR error getting item: 90819037 from https://api.firststreet.org/v1/location/summary/property/90819037? 2021-03-10 09:07:19,069 root ERROR error getting item: 90817088 from https://api.firststreet.org/v1/location/summary/property/90817088? 2021-03-10 09:07:19,071 root ERROR error getting item: 90817113 from https://api.firststreet.org/v1/location/summary/property/90817113? 2021-03-10 09:07:19,153 root ERROR error getting item: 90797710 from https://api.firststreet.org/v1/location/summary/property/90797710? 2021-03-10 09:07:19,157 root ERROR error getting item: 90817915 from https://api.firststreet.org/v1/location/summary/property/90817915? 2021-03-10 09:07:19,159 root ERROR error getting item: 90817953 from https://api.firststreet.org/v1/location/summary/property/90817953? 2021-03-10 09:07:19,168 root ERROR error getting item: 90816276 from https://api.firststreet.org/v1/location/summary/property/90816276? 2021-03-10 09:07:19,170 root ERROR error getting item: 90817938 from https://api.firststreet.org/v1/location/summary/property/90817938? 2021-03-10 09:07:19,171 root ERROR error getting item: 90817889 from https://api.firststreet.org/v1/location/summary/property/90817889? 2021-03-10 09:07:21,243 root ERROR error getting item: 90817858 from https://api.firststreet.org/v1/location/summary/property/90817858? 2021-03-10 09:07:21,282 root ERROR error getting item: 90817926 from https://api.firststreet.org/v1/location/summary/property/90817926? 2021-03-10 09:07:21,284 root ERROR error getting item: 90797913 from https://api.firststreet.org/v1/location/summary/property/90797913? 2021-03-10 09:07:21,285 root ERROR error getting item: 90817928 from https://api.firststreet.org/v1/location/summary/property/90817928? 5%|▌ | 5400/99999 [05:32<1:37:09, 16.23it/s] 2021-03-10 09:07:26,355 asyncio ERROR Task exception was never retrieved future: exception=RuntimeError('Session is closed')> Traceback (most recent call last): File "/Users/rcoskrey/opt/anaconda3/lib/python3.8/asyncio/tasks.py", line 280, in __step result = coro.send(None) File "/Users/rcoskrey/opt/anaconda3/lib/python3.8/site-packages/firststreet/http_util.py", line 63, in bound_fetch return await self.execute(endpoint, session, throttler) File "/Users/rcoskrey/opt/anaconda3/lib/python3.8/site-packages/firststreet/http_util.py", line 115, in execute async with session.get(endpoint[0], headers=headers) as response: File "/Users/rcoskrey/opt/anaconda3/lib/python3.8/site-packages/aiohttp/client.py", line 1117, in __aenter__ self._resp = await self._coro File "/Users/rcoskrey/opt/anaconda3/lib/python3.8/site-packages/aiohttp/client.py", line 381, in _request raise RuntimeError("Session is closed") RuntimeError: Session is closed
rcoskrey commented 3 years ago

I am also happy to share the dataset of FSIDs that I am working with if that would be helpful.