lk-geimfari / mimesis

Mimesis is a robust data generator for Python that can produce a wide range of fake data in multiple languages.
https://mimesis.name
MIT License
4.39k stars 330 forks source link

Added support of remote data #393

Closed lk-geimfari closed 6 years ago

lk-geimfari commented 6 years ago

Idia is very simple, just look at the code below:

from mimesis.package import DataPackage

datapack = DataPackage(url='http://dataset.example/dir/dir/datapack.json')
data = datapack.get('super_data')

for item in data:
    # ...

This provider can be used extracting data from remote .csv, .json and .zip files.

lk-geimfari commented 6 years ago

I'm always open to suggestions and criticism.

lk-geimfari commented 6 years ago

@sobolevn @duckyou What do you think?

lk-geimfari commented 6 years ago

Datahub uses a similar way to get custom data from web: http://datahub.io/core/gold-prices#python

sobolevn commented 6 years ago

I would also make this a separate package. Since it would require additional requirements:

lk-geimfari commented 6 years ago

@sobolevn So, I'll close this issue, because we'll not add it to mimesis. I will try to implement this as a separate package in my spare time.