Azure / azure-functions-eventhubs-extension

Event Hubs extension for Azure Functions
MIT License
20 stars 26 forks source link

User configurable initial offset support #79

Closed sidkri closed 3 years ago

sidkri commented 3 years ago

This change allows users to specify the point in an event stream that processing should start at if no checkpoint exists. Checkpoints per Event Hubs partition is maintained in storage and existing values if any should be deleted for this configuration to apply on the first run of the function(s).

Event Hubs extension configuration options added to host.json:

"eventHubs": {
    ....
    "initialOffsetOptions": {
        "type": "<fromStart OR fromEnd OR fromEnqueuedTime>",
        "enqueuedTime": "<time in any format supported DateTime.Parse() e.g. 2020-10-26T20:31Z>"
    }
}

Initial Offset options supported:

Design considerations:

Pull request checklist

sidkri commented 3 years ago

/azp run

azure-pipelines[bot] commented 3 years ago
Azure Pipelines successfully started running 1 pipeline(s).
sidkri commented 3 years ago

Will not publish this version until the Azure docs PR is ready to merge as well