search

GoogleCloudPlatform / flink-on-k8s-operator

[DEPRECATED] Kubernetes operator for managing the lifecycle of Apache Flink and Beam applications.
Apache License 2.0
658 stars 266 forks source link

Provide a source of infinite text stream for test purposes #60

Open functicons opened 4 years ago

functicons commented 4 years ago

We need an easy way to get an infinite input stream to test long-running stream processing. Sometimes setting up Kafka or Pub/Sub is too complex for test purposes. Flink socketTextStream seems to be an option. We can consider provide a simple TCP server which serves infinite text streams.

functicons commented 4 years ago

https://github.com/functicons/go-examples/tree/master/textstream

hongyegong commented 4 years ago

A simple socket streaming flink job: https://github.com/hongyegong/streaming-flink-job/tree/master