search

databendlabs / databend

𝗗𝗮𝘁𝗮, 𝗔𝗻𝗮𝗹𝘆𝘁𝗶𝗰𝘀 & 𝗔𝗜. Modern alternative to Snowflake. Cost-effective and simple for massive-scale analytics. https://databend.com
https://docs.databend.com
Other
7.87k stars 752 forks source link

Feature: Allow COPY FROM AVRO file #8017

Open Xuanwo opened 2 years ago

Xuanwo commented 2 years ago

Summary

https://avro.apache.org/

Apache Avro™ is the leading serialization format for record data, and first choice for streaming data pipelines. It offers excellent schema evolution, and has implementations for the JVM (Java, Kotlin, Scala, …), Python, C/C++/C#, PHP, Ruby, Rust, JavaScript, and even Perl.

ClSlaid commented 2 years ago

Figuered out how to implement, working on it.

inviscid commented 4 months ago

Is there any word on whether this will be available in an upcoming release?

Xuanwo commented 4 months ago

Is there any word on whether this will be available in an upcoming release?

Hi, there's no effort for this task. Perhaps you could contact @BohuTANG for your needs?

BohuTANG commented 4 months ago

@inviscid We haven't made any plans regarding this yet. Could you provide more details about these requirements?

rdonnelly3 commented 3 months ago

We have many files in avro format and would like to be able to create a stage with file_format = (type = AVRO)