distributed writing

[evdokim]

@alberskib It's a not priority thing at all, but if we will have time it would be nice to have it in the end. The idea is to implement is as simple as possible: writers will produce write operations that than will executed in EC2 instances. Compota can be useful for this: basically you will need only implement some specific interface for worker. I will prepare more detailed document about it, but so far you can take a look on this example: https://github.com/ohnosequences/compota/blob/master/compota-wordcount/src/main/scala/WordCount.scala

[alberskib]

@evdokim I think that it is not only really useful but also extremely interesting. I will start working on it as soon as possible.

[evdokim]

cool that you are interested in it, I have to write something about it, but anyway feel free to ask

[evdokim]

@alberskib I wrote a small FAQ about compota: https://github.com/ohnosequences/compota/blob/master/doc/faq.md

you can also take a look on documentation of previous version of it -- nispero. The main difference between them is that compota you can do composition (like composition of functions) of several nisperos.

[alberskib]

@evdokim Is there any chance that compota will be upated to the scala 2.11?

[evdokim]

@alberskibcode migration to 2.11 shouldn't break the code of compota, but I'm not sure about its dependencies, let me check it

[alberskib]

I tried and there was lots of dependencies to other projects from ohnosequences

[evdokim]

yes it's true, I don't have time to update all of them now, so I just set scala version to 2.11 and force sbt to use 2.10 versions of dependencies. It compiles, but I'm sure that it actually works:

https://github.com/ohnosequences/compota/tree/scala-2.11

[alberskib]

Thanks

[evdokim]

you are welcome, try to compile https://github.com/ohnosequences/compota/tree/master/compota-wordcount with new version of compota, I think that it will fail with dependencies conflicts but it quite easy to fix

[alberskib]

Now https://github.com/ohnosequences/compota/tree/master/compota-wordcount compile without any dependency conficts (sbt compile)

[evdokim]

nice)

[evdokim]

https://github.com/ohnosequences/compota/blob/master/doc/usage-faq.md

[alberskib]

https://github.com/ohnosequences/compota/blob/master/doc/usage-faq.md

It cannot be sbt subproject?

[evdokim]

probably yes, I haven't tested it, but supposed workflow for compota is to create an separated sbt project for every execution