search

Azure / azure-event-hubs-go

Golang client library for Azure Event Hubs https://azure.microsoft.com/services/event-hubs
MIT License
90 stars 69 forks source link

Intermittent PUT blob failed when updating checkpoint store #291

Closed Hilda-S closed 1 year ago

Hilda-S commented 1 year ago

(note: I (@richardpark-msft) reformatted this slightly so the output is a bit more readable)

Issue: We encountered below error intermittently while using EH GO SDK to fetch data from the Event Hub. It states that the blob already exists but we didn't change anything from our end just using the SDK to store the checkpoint.

ERROR: -> github.com/Azure/azure-storage-blob-go/azblob.newStorageError, /go/pkg/mod/github.com/!azure/azure-storage-blob-go@v0.8.0/azblob/zc_storage_error.go:42 ===== RESPONSE ERROR (ServiceCode=BlobAlreadyExists) ===== Description=The specified blob already exists. RequestId:23be6173-101e-0037-6a0c-f19f9d000000 Time:2023-09-27T06:30:10.7840577Z, Details: Code: BlobAlreadyExists PUT https://himsdata.blob.core.windows.net/irentblob/0?timeout=61 Authorization: REDACTED Content-Length: [80] If-None-Match: [*] User-Agent: [Azure-Storage/0.7 (go1.14.14; linux)] X-Ms-Blob-Cache-Control: [] X-Ms-Blob-Content-Disposition: [] X-Ms-Blob-Content-Encoding: [] X-Ms-Blob-Content-Language: [] X-Ms-Blob-Content-Type: [] X-Ms-Blob-Type: [BlockBlob] X-Ms-Client-Request-Id: [c23d830c-8bd6-42b7-6582-7c924ea1feb3] X-Ms-Date: [Wed, 27 Sep 2023 06:30:10 GMT] X-Ms-Version: [2018-11-09]#012

github.com/Azure/azure-event-hubs-go

we are using v3 version by this command: go get -u github.com/Azure/azure-event-hubs-go/v3

import ( "context" "fmt" "os" "os/signal" "time" "github.com/Azure/azure-event-hubs-go/v3" )

richardpark-msft commented 1 year ago

I'm not able to repro this particular bug.

I'm curious if it's related to using an older version of the package, or storage (above you've got azure/azure-storage-blob-go@v0.8.0).

In my go.mod for my test application, based on the latest azure-event-hubs-go package:

require(
  github.com/Azure/azure-storage-blob-go v0.15.0
  github.com/Azure/azure-event-hubs-go/v3 v3.6.1
)

What does your go.mod show?

richardpark-msft commented 1 year ago

Hi @Hilda-S, I'm closing this issue out but please reopen if you are able to try with the latest storage.