search

peelframework / peel

Peel is a framework that helps you to define, execute, analyze, and share experiments for distributed systems and algorithms.
http://peel-framework.org
Apache License 2.0
27 stars 32 forks source link

Migrate systems to DistributedLogCollection #84

Closed aalexandrov closed 8 years ago

aalexandrov commented 8 years ago

The regular LogCollection logic does not work due to large latencies when reading remotely via NFS.

We already migrated Flink and DStat to the DistributedLogCollection trait, and I suggest to do so with all other systems which produce logs on multiple hosts.

The issue is up for grabs.

aalexandrov commented 8 years ago

I migrated HDFS2 with the latest batch of changes.