Added strip_protocol from fsspec to get the required URL.

uber / petastorm

Petastorm library enables single machine or distributed training and evaluation of deep learning models from datasets in Apache Parquet format. It supports ML frameworks such as Tensorflow, Pytorch, and PySpark and can be used from pure Python code.

Apache License 2.0

1.78k stars 285 forks source link

Added strip_protocol from fsspec to get the required URL. #693

Closed manjuransari-zz closed 3 years ago

manjuransari-zz commented 3 years ago

Fsspec provides a method strip_protocol that helps in getting path part of full URL. Currently, the url part is resticted. Where as fsspec provides a way to add our own implementation for getting the path part of the URL.

CLAassistant commented 3 years ago

All committers have signed the CLA.