search

sadikovi / spark-netflow

NetFlow data source for Spark SQL and DataFrames
Apache License 2.0
18 stars 11 forks source link

Refactor RDD compute method #60

Closed sadikovi closed 7 years ago

sadikovi commented 7 years ago

Currently NetFlowFileRDD compute method is very large, and it is difficult to introduce new logic. Should break it into smaller methods that we can unit-test.