Support botocore.response.StreamingBody from boto3 as input to smart_open.smart_open()

[alexindaco]

I noticed that for boto.s3.key.Key you use io.BufferedReader.

boto3's botocore.response.StreamingBody has the attribute _raw_stream which it looks like you can just pass to io.BufferedReader and it works.

>>> s3 = boto3.resource('s3',
...          aws_access_key_id=ACCESS_KEY,
...          aws_secret_access_key=ACCESS_SECRET)
>>> a=s3.ObjectSummary(BUCKET_NAME, KEY_NAME).get()["Body"]
>>> a
<botocore.response.StreamingBody object at 0x108898690>
>>> stream = io.BufferedReader(a._raw_stream)
>>> stream.readline()
'first line\n'

[mpenkov]

This is currently possible on the master branch:

>>> from smart_open import open
>>> import boto3
>>> s3 = boto3.resource('s3')
>>> summary = s3.ObjectSummary('commoncrawl', 'robots.txt')
>>> stream = summary.get()['Body']._raw_stream
>>> open(stream).read()
'User-Agent: *\nDisallow: /'

I don't think any further work is necessary here. @ceruly Can you please let me know if I've misunderstood something?