search

aphyr / tesser

Clojure reducers, but for parallel execution: locally and on distributed systems.
871 stars 39 forks source link

Support For Apache Kafka #1

Open joestein opened 9 years ago

joestein commented 9 years ago

I was looking at 


;; Tests

(defspec map-spec
  test-count
  (prop/for-all [chunks (chunks gen/int)]
                (is (= (->> (t/map inc)
                            (t/map (partial * 2))
                            (t/into (multiset))
                            (t/tesser chunks))
                       (->> chunks
                            flatten1
                            (map inc)
                            (map (partial * 2))
                            (into (multiset)))))))

And it seems that to support Apache Kafka reads using something like https://github.com/pingles/clj-kafka would be just a different chunks function getting messages from topics in Kafka?