search

graphsense / graphsense-lib

A central repository for python utility functions and everything that interacts with the graphsense backend. Its CLI interface can be used to control important graphsense maintainance tasks.
MIT License
6 stars 1 forks source link

Include Export CSV as standard ingest sink #6

Closed soad003 closed 2 months ago

soad003 commented 1 year ago

currently export as csv is a seperate cli entrypoint. It would make sense to harmonize with other similar ingest parts e.g. the parquet ingest.

soad003 commented 2 months ago

We do not want to maintain the csv export feature longer. Csv's are not efficient, the main benefit was compatibility with other tools. Eg. it was easy to use ds-bulk to ingest a new ethereum raw dataset into cassandra using csvs. With the new delta lake feature of graphsense we want to replace the csv tools, as a compatibility solution we want to provide a csv export feature from the csv files, that is used as needed.

https://github.com/graphsense/graphsense-lib/issues/18