amphi-ai / amphi-etl

Low-code ETL for structured and unstructured data. Generates Python code you can deploy anywhere.
https://docs.amphi.ai
Other
551 stars 12 forks source link

Input / Output MQTT Connector #34

Open tobehn opened 1 week ago

tobehn commented 1 week ago

First of, great tool and thank you very much for making it open source.

An Input and Output Node to connect to a MQTT-Broker would be awesome. The node could subscribe to a topic or use a the '#' connotation for subscribe to several topics.

https://github.com/mqttjs/MQTT.js/

tgourdel commented 1 week ago

Thanks for your suggestion @tobehn. I'll take a look

tgourdel commented 1 week ago

Hi @tobehn, I'm not familiar with MQTT. I believe it's for IoT messaging mainly. What is your use case with it? Thanks

tobehn commented 1 week ago

MQTT is increasingly used for industrial communication. A lot of Data is generated by machines. The idea is to connect to a MQTT Broker and subscribe to Topic data. This data can then be harmonized and further edited in structure by amphi and then either be send back to the MQTT Broker or to other outputs via amphi.

Have a look at HighByte which is as far as i understand a commercial ETL that focusses on industrial data. https://guide.highbyte.com/configuration/connect/connections/ Cheers