search

martindurant / rfsspec

Rust python FS
MIT License
32 stars 2 forks source link

Mixed Python + Rust package #1

Closed douglasdavis closed 1 year ago

douglasdavis commented 1 year ago

This PR makes the Rust based extension module importable as rfsspec.rfsspec

martindurant commented 1 year ago

Copying out the draft PR from fsspec?

This is good to be able to do testing. The original HTTPFileSystem has tests we could reuse, except that rfsspec doesn't pass on header values to the request yet.

douglasdavis commented 1 year ago

Just experimenting to allow being able to import pure Python objects from rfsspec as well, can now run e.g.

import rfsspec.html
fs = rfsspec.http.HTTPFileSystem(...)
douglasdavis commented 1 year ago

Copying out the draft PR from fsspec?

yep just copied from fsspec.implementions.http_rust.py

martindurant commented 1 year ago

I'll put this in and continue iterating, unless you have more you want to do.

douglasdavis commented 1 year ago

Nope that sounds good!