JuliaServices / CloudStore.jl

A simple, consistent, and performant API for interacting with common cloud storage abstractions
Other
16 stars 8 forks source link

[wip] add support for Azure appendable blobs #45

Closed vilterp closed 1 year ago

vilterp commented 1 year ago

See https://learn.microsoft.com/en-us/rest/api/storageservices/understanding-block-blobs--append-blobs--and-page-blobs#about-append-blobs

vilterp commented 1 year ago

Locally I'm getting a Bad Request back from Azurite, sadly with no error message 😕

 caused by: HTTP.Exceptions.StatusError(400, "PUT", "/devstoreaccount1/jl-azurite-9952/my_append_blob?comp=block", HTTP.Messages.Response:
  """
  HTTP/1.1 400 Bad Request
  Server: Azurite-Blob/3.24.0
  Date: Tue, 12 Sep 2023 22:42:54 GMT
  Connection: keep-alive
  Keep-Alive: timeout=5
  Content-Length: 0

  """)
  Stacktrace:
   [1] (::HTTP.ExceptionRequest.var"#exceptions#2"{HTTP.ExceptionRequest.var"#exceptions#1#3"{CloudBase.var"#cloudsign#64"{CloudBase.var"#cloudsign#63#65"{typeof(HTTP.StreamRequest.streamlayer)}}}})(stream::HTTP.Streams.Stream{HTTP.Messages.Response, HTTP.Connections.Connection{OpenSSL.SSLStream}}; status_exception::Bool, timedout::ConcurrentUtilities.TimedOut{HTTP.Messages.Response}, logerrors::Bool, logtag::Nothing, kw::Base.Pairs{Symbol, Any, NTuple{8, Symbol}, NamedTuple{(:iofunction, :decompress, :azure, :aws, :awsv2, :require_ssl_verification, :verbose, :credentials), Tuple{Nothing, Nothing, Bool, Bool, Bool, Bool, Int64, CloudBase.AzureCredentials}}})
     @ HTTP.ExceptionRequest ~/.julia/packages/HTTP/Y2JKB/src/clientlayers/ExceptionRequest.jl:19

Maybe it's missing a request header like Content-Length or something? I was hoping Azure.put would take care of that… 🤔

codecov[bot] commented 1 year ago

Codecov Report

Patch coverage: 100.00% and project coverage change: +0.14% :tada:

Comparison is base (328b427) 83.13% compared to head (18d0dc3) 83.27%.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #45 +/- ## ========================================== + Coverage 83.13% 83.27% +0.14% ========================================== Files 7 7 Lines 587 592 +5 ========================================== + Hits 488 493 +5 Misses 99 99 ``` | [Files Changed](https://app.codecov.io/gh/JuliaServices/CloudStore.jl/pull/45?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=JuliaServices) | Coverage Δ | | |---|---|---| | [src/blobs.jl](https://app.codecov.io/gh/JuliaServices/CloudStore.jl/pull/45?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=JuliaServices#diff-c3JjL2Jsb2JzLmps) | `90.19% <100.00%> (+1.06%)` | :arrow_up: |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

vilterp commented 1 year ago

No longer planning on using this; will resurrect if needed