viknesh-iit / Learningspark

0 stars 0 forks source link

Operations that can be done DStream #1

Open viknesh-iit opened 7 years ago

viknesh-iit commented 7 years ago

Operations that can be done DStream

Ans:"DStream (short for Discretized Stream) is the basic abstraction in Spark Streaming and represents a continuous stream of data. DStreams can be created either from input data streams from sources such as Kafka, Flume, and Kinesis, or by applying operations on other DStreams. Internally, a DStream is represented as a sequence of RDD objects"

We can performe large no of operations using data streaming. if we intigerate data streaming with machine learning algorithm, we can go for pridictions.. which can solve no.s of issues example climate prediction, digital data streaming, airport security system by sensing body heat.

   audio streaming
viknesh-iit commented 7 years ago

create a Dstream from filestream. Find what are the operations that done - Transformations and Output operations