are there examples showing how to convert csv to arvo?

Azure / usql

U-SQL Examples and Issue Tracking

http://usql.io

MIT License

232 stars 683 forks source link

Open alexgman opened 4 years ago

alexgman commented 4 years ago

are there examples showing how to convert csv to arvo using u-sql?

dylanhernandez1 commented 1 year ago

I'm not sure whether this applies for u-sql or not, but you can use Azure Data Lake Analytics. There is a sample Avro extractor at https://github.com/Azure/usql/blob/master/Examples/DataFormats/Microsoft.Analytics.Samples.Formats/Avro/AvroExtractor.cs. You can easily adapt the code into an out putter. Another possibility is to fire up an HDInsight cluster on top of your data lake store and use Pig, Hive or Spark.