aws-samples / amazon-sagemaker-local-mode

Amazon SageMaker Local Mode Examples
MIT No Attribution
242 stars 59 forks source link

tfrecord support in local mode? #21

Open gitrc opened 1 year ago

gitrc commented 1 year ago

It appears that only 'Line' and 'RecordIO' split_type are supported in local mode. Is it possible to support TFRecord? Thank you.

eitansela commented 1 year ago

Hello @gitrc , can I please have a reference from where did you get the information that only 'Line' and 'RecordIO' split_type are supported in local mode? Thanks!

gitrc commented 1 year ago

@eitansela sure, https://github.com/aws/sagemaker-python-sdk/blob/9f400bd0f76a6c95807382314e4ad5074c4d1b28/src/sagemaker/local/data.py#L60

eitansela commented 1 year ago

Yes you are right. You can open an issue in SageMaker Python SDK GitHub repo, and to expedite it, you can write me a private mail stating what is the company you work for, so I can introduce you to the Machine Learning Specialist working with you.

gitrc commented 1 year ago

Thank you, I created https://github.com/aws/sagemaker-python-sdk/issues/3626 and will attempt to contact you directly via other means.