search

exasol / ai-lab

Development environment for data science developers
MIT License
3 stars 0 forks source link

Examine write access to BucketFS #196

Closed ckunki closed 6 months ago

ckunki commented 6 months ago

Background and scenario

PM tried out the AI-Lab using

See Confluence.

Problem

AI-Lab failed to write files to BucketFS.

curl https://demodb.exasol.com:2202

bucketfs-python seems to be able to write to the bucket

ckunki commented 6 months ago

According to @ahsimb the AI-Lab is hard-coded to always use HTTP only. In contrast the demodb only supports HTTPS connections.

A potential mitigation would be to enhance the AI-Lab to support individual select of whether to use HTTP or HTTPS. For development and testing with Docker-DB and ITDE the developers need to make the Docker-DB expose the HTTPS port.

@ahsimb also reports bucketfs-python to be multiple times slower than curl, see separate ticket https://github.com/exasol/bucketfs-python/issues/92.

We should check, if transformers-extension maybe uses an out-dated version of bucketfs-python.

Nicoretti commented 6 months ago

Time: ~1d

tkilias commented 6 months ago

We solved the issue for certificates from trusted CA. The fix for self-signed certificates takes longer and will be tracked in https://github.com/exasol/ai-lab/issues/218