search

MicrosoftDocs / azure-docs

Open source documentation of Microsoft Azure
https://docs.microsoft.com/azure
Creative Commons Attribution 4.0 International
10.31k stars 21.49k forks source link

Message Route (custom endpoint) limit set to 10 #32624

Closed lciocci closed 5 years ago

lciocci commented 5 years ago

[Enter feedback here]

Are there any plans to extend the number of custom endpoints beyond 10? We currently take advantage of IoT Hub Routing and have built rules to route messages to specific Event Hubs -> Service Fabric applications (microservices). As we further develop our applications we'd like to fan out incoming messages to processes that are specific each a given message Type (and Subtype).

Prior to IoT Hub Routing we had used Azure Stream Analytics examine the payload and route the incoming message accordingly. This was both slow, expensive, and not reliable compare to IoT Hub Routing. If there are no plans to increase this limit, are there perhaps alternatives to IoT Hub Routing that we should explore?

Document Details

⚠ Do not edit this section. It is required for docs.microsoft.com ➟ GitHub issue linking.

robinsh commented 5 years ago

@ash2017 Is there anything you can share that would be helpful?

lciocci commented 5 years ago

One thing to add is that we are aware of routing via Event Grid. We are currently dependent on preserving the processing of messages in order in which they're received. As Event Grid does not support the ordering of messages, Event Grid is not being considered at this time.

ash2017 commented 5 years ago

IoT Hub now publishes device telemetry events on Event Grid in public preview. With this capability, IoT Hub expands the services data can reach, beyond the endpoints supported through message routing. https://docs.microsoft.com/en-us/azure/iot-hub/iot-hub-event-grid

lciocci commented 5 years ago

Apologies but I'm not sure that my latest comment had been seen. We cannot rely on Event Grid as it does not preserve message order when processing messages.

ash2017 commented 5 years ago

We will need more information on the use case, what is the end to end scenario and customer name and opportunity size so we can look into supporting.

lciocci commented 5 years ago

My name is Louis Ciocci and I'm a Software Architect for Crestron Electronics, Inc. The idea we're looking to implement is to fan out incoming messages to be processed by their respective microservices based on entries contained in the message's Properties dictionary.

ash2017 commented 5 years ago

Thank you Louis. Please share a contact email and I will follow up with you.

lciocci commented 5 years ago

Might there be a mechanism by which I can share my (and other team member's) email but not in a public forum?

robinsh commented 5 years ago

@lciocci You can e-mail me at robin dot shahan at microsoft dot com, and I will forward to Ashita, who can then respond to you directly.

AshokPeddakotla-MSFT commented 5 years ago

@lciocci As suggested, please send an email and this will be addressed offline. We will now proceed to close this thread. If there are further questions regarding this matter, please tag me in your reply. We will gladly continue the discussion and we will reopen the issue.

marosrojis commented 2 years ago

@ash2017 I would like to ask you, how did you help @lciocci with his problem? I'm solving similar problem right now and I would be really glad for your help.

Thank you.

Usha-Rathnavel commented 2 years ago

@ash2017 I would like to ask you, how did you help @lciocci with his problem? I'm solving similar problem right now and I would be really glad for your help.

Thank you.

@marosrojis have you tried using Azure Functions or Event grid? Depending on your use-case, there are a few options that we could explore . Please drop an email to usrathna at microsoft dot com, with more details on scenario and we can see how we can help. Thanks!

survivant commented 1 year ago

@Usha-Rathnavel @robinsh I have a similar request. I have some Spring apps that received messages : like telemetry, new devices, digital twin properties that changed..

I have a IOT HUB that use 10 custom endpoints to eventhubs (consumed by Spring apps). I need to add new routes (3) for a new Spring apps.

What I can do to bypass the limit of 10 endpoints ?

I could use one endpoint for all the devicelifecycle to a eventhub and use different group-consumer to solve that. But I like the idea to have more than 10.

Usha-Rathnavel commented 1 year ago

@survivant Thank you for reaching out. Have you tried using Event Grid Telemetry events? This should help you go beyond 10 consumers for the events. Currently, we support up to 10 direct routing endpoints from IoT Hub. Hope this helps!

AiHaibara commented 11 months ago

@survivant Thank you for reaching out. Have you tried using Event Grid Telemetry events? This should help you go beyond 10 consumers for the events. Currently, we support up to 10 direct routing endpoints from IoT Hub. Hope this helps! hello @survivant what's the throughput for the routing endpoints or eventgrid Telemetry is? does this is related iothub throughput units? if using eventgrid for this, should using system topic or not?