Can you add a FileTimeRotationPolicy(3600, Units.SECONDS);

ptgoetz / storm-hdfs

Storm components for interacting with HDFS file systems

Apache License 2.0

61 stars 59 forks source link

Can you add a FileTimeRotationPolicy(3600, Units.SECONDS); #10

Closed evidanary closed 10 years ago

evidanary commented 10 years ago

I want to rotate the file every 10 minutes regardless of the size. The rotated file will land in a HIVE table directory. This way I can have an SLA for data liveness when someone queries a hive table.

FileTimeRotationPolicy(600, Units.SECONDS); //For 10 minutes FileTimeRotationPolicy(60, Units.MINUTES); //For One Hour

ptgoetz commented 10 years ago

Added ability to rotate on time intervals.