docs

[vpodgurschi-mm]

http://highscalability.com/blog/2015/12/9/free-red-book-readings-in-database-systems-5th-edition.html https://www.dropbox.com/sh/9wlcv9shyijfa3k/AAByp0jIRDdxYWP_xYjYAE3xa?dl=0

[vpodgurschi-mm]

apache flink - distributed stream processing

selections from the talks of the recent FlinkForward conference http://flink-forward.org/?post_type=session

• William Vambenepe – Google Cloud Dataflow and Flink
  • presentation: https://www.youtube.com/watch?v=y7f6wksGM6c
  • slides: http://www.slideshare.net/FlinkForward/william-vambenepe-google-cloud-dataflow-and-flink-stream-processing-by-default
  • Google DataFlow paper: http://www.vldb.org/pvldb/vol8/p1792-Akidau.pdf
  • notes: great presentation on data streaming concepts, Google's position and Flink
• Flink DataStream API
  • presentations:
  • slides: http://www.slideshare.net/FlinkForward/apache-flink-training-datastream-api-part-1-basic http://www.slideshare.net/FlinkForward/apache-flink-training-datastream-api-part-2-advanced
• Data flow vs. procedural programming: How to put your algorithms into Flink
  • presentation: https://www.youtube.com/watch?v=6BjoW2Vs2C0
  • slides: http://www.slideshare.net/mikiobraun/flink-meetup2015
  • notes: parallel data flow / ParDo
• Fault Tolerance and Recovery of Flink Jobs
  • presentation: https://www.youtube.com/watch?v=UV6vP0IB17A
  • slides: http://www.slideshare.net/FlinkForward/till-rohrmann-fault-tolerance-and-job-recovery-in-apache-flink
  • Asynchronous Barrier Snapshotting paper: http://arxiv.org/pdf/1506.08603v1.pdf
• Notions of Time – How Apache Flink Handles Time and Windows
  • presentation: https://www.youtube.com/watch?v=xiKsOocNkDA
  • slides: http://www.slideshare.net/FlinkForward/aljoscha-krettek-notions-of-time
• Cascading (3.x) on Flink
  • presentation: https://www.youtube.com/watch?v=G7JlpARrFkU
  • slides: http://www.slideshare.net/FlinkForward/fabian-hueske-training-cascading-on-flink
  • code: https://github.com/dataArtisans/cascading-flink

[vpodgurschi-mm]

Excellent talks on streaming data processing, and Apache Flink

Volker Markl: Big Data Management and Apache Flink https://www.youtube.com/watch?v=iL8plQ3vWf8 -> origins of Flink (Stratosphere); shortcomings of MapReduce; memory management, out-of-core, delta iterations, cyclic data processing graphs (iterations), schema-on-read etc

Seif Haridi: Apache Flink Streaming https://www.youtube.com/watch?v=P4ERkq0rnoI http://www.slideshare.net/dato-inc/sics-apache-flink-streaming?qid=7db7d379-29b9-4d8a-aa7b-ee857e117164 -> great touch on all aspects, including fault tolerance, flow control, windowing

Matthias Sax: Feeding a Squirrel in Time - Windows in Flink https://www.youtube.com/watch?v=ZVZyg0aWbMU -> comparison with other streaming systems; windowing; code samples

Fabian Hueske: Apache Flink Batch Advanced https://www.youtube.com/watch?v=1yWKZ26NQeU

Paris Carbone: Data Stream Processing with Apache Flink https://www.youtube.com/watch?v=L3DLV0GtMSM -> more generic talk on distributed streaming processing: windowing, state (synopsis), partitioning; comparison of systems

Gyula Fora: Building Stream Processing Pipelines https://www.youtube.com/watch?v=ONKDfgrE9ng