Closed kylebarron closed 1 month ago
import boto3
import object_store_rs as obs
store = obs.store.S3Store.from_session(boto3.Session(), "ookla-open-data")
path = "parquet/performance/type=mobile/year=2023/quarter=3/2023-07-01_performance_mobile_tiles.parquet"
resp = obs.get(store, path)
async for buf in aiter(resp):
print(len(buf))
that's super cool
This is super cool. Really excited to test this tomorrow. Original credit goes to @timteeee in https://github.com/roeap/object-store-python/pull/29
list
so that we return an iterator, instead of materializing the entire list result at once.__iter__
that returnsself
is something I need to do inarro3
; somewhere I have to calliter()
manually, or something like that.delete_stream
methodTomorrow I'll add a test for this.