databricks spark-avro issues

databricks / spark-avro

Avro Data Source for Apache Spark

http://databricks.com/

Apache License 2.0

539 stars 310 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Update README.

#297 rxin closed 5 years ago
1
spark-avro merged into spark 2.4

#296 fxbonnet opened 5 years ago
0
Avro schemas with a self-reference yield StackOverflowError

#295 quadrokeith opened 5 years ago
0
Spark 2.3 support

#294 functicons closed 5 years ago
3
Custom read schema support for Spark 1.6

#293 nshah99 opened 5 years ago
0
Is it really necessary to support Java 7?

#292 ivanobulo opened 6 years ago
0
Implemented logical type converters for Date, Timestamp and Decimal type

#291 ivanobulo closed 5 years ago
3
Spark1.6 with databricks 2.0.1 : Exception in thread "main" java.lang.UnsupportedOperationException: This mix of union types is not supported (see README): ArrayBuffer(RECORD) at

#290 sagarsvp opened 6 years ago
0
spark 2.1.0 : NullpointerException Issue in java while reading avro file as dataframe with kryo enabled as serializer

#289 erparas closed 5 years ago
2
why all fields are nullable

#288 yuryn opened 6 years ago
1
Support for more compression algorithms in addition to snappy and deflate

#287 BensonQiu opened 6 years ago
0
Do not ignore avro files without extensions by default

#286 MaxGekk closed 6 years ago
4
'Unknown datum type' exception generated by ArrayType elements

#285 florin1288 opened 6 years ago
1
Request to add supported options list in README

#284 shsachin opened 6 years ago
0
Reader writer improvements

#283 smiklos opened 6 years ago
1
Upgrade to Spark 2.3.0

#282 xmj closed 6 years ago
2
Py4JJavaError: An error occurred while calling o37.save.

#281 surajkb74 opened 6 years ago
0
Spark 2.2 + spark-avro_2.11-4.0.0.jar is very slow for certain job comparing Spark 1.6.3 + spark-avro_2.10-2.0.1.jar

#280 java8964 opened 6 years ago
2
Implementation of 'from_avro' function

#279 ivanobulo closed 5 years ago
4
Provider org.apache.spark.sql.hive.orc.DefaultSource could not be instantiated

#278 sunny1978 opened 6 years ago
3
using the SchemaConverters.convertStructToAvro

#277 divo77 opened 6 years ago
1
DecimalType is mapped to avro bytes with logicalType

#276 peter-ungvari opened 6 years ago
5
Add support to convert to Avro IndexedRecord

#275 mquraishi opened 6 years ago
0
Row to AVRO for Streaming Usecase

#274 sunny1978 opened 6 years ago
2
Make it possible to load avro files from multiple paths

#273 amanjpro closed 6 years ago
3
Fails to write record containing map of array of record

#272 laymain opened 6 years ago
3
TimeUnit conversion for BigQuery compatibility

#271 devlucasc opened 6 years ago
3
TimeUnit conversion for BigQuery compatibility

#270 devlucasc closed 6 years ago
0
Pick last file sorted by path for schema

#269 koertkuipers opened 6 years ago
10
Read bytes and fixed avro types with decimal logicalType as DecimalType

#268 peter-ungvari opened 6 years ago
2
Big performance issue when moving from 2.0.1 to 4.0.0 when loading column of type ArrayType

#267 arthurdk opened 6 years ago
4
Support for Spark ML Vector types

#266 tovbinm opened 6 years ago
0
Getting schema name from Avro file

#265 dmateusp opened 6 years ago
0
can't add avro_2.11:4.0.0 in spark-shell

#264 seekmayank opened 6 years ago
3
Upgrade SBT and corresponding plugins.

#263 aa8y closed 6 years ago
3
Fix null Timestamp/Date coercion to 0 epoch.

#262 aa8y closed 6 years ago
13
How to convert Avro Schema Object to StructType?

#261 kant111 opened 6 years ago
2
How to parse Avro messages while read a stream of messages from Kakfa in Spark 2.2.0?

#260 kant111 opened 6 years ago
21
spark-avro ignores the compression option in DataFrameWriter

#259 juarezr opened 6 years ago
0
Enhance scala code style check

#258 gengliangwang closed 6 years ago
3
Support for logical datatype like decimal type

#257 varsha-abhinandan opened 6 years ago
7
In 1.8 generated fixed types do not extend GenericData.Fixed anymore

#256 steven-aerts closed 6 years ago
6
Namespace name is set when undefined

#255 jung-kim opened 6 years ago
8
How to convert RDD[GenericRecord] to dataframe in scala ?

#254 slim-azaiz opened 6 years ago
0
Add Date and Timestamp data types support when reading avro fields

#253 viirya closed 6 years ago
9
Simple fix hyperlink for v3.2.0 in README

#252 gengliangwang closed 6 years ago
1
Update README and version.sbt in preparation for 4.0.0 release

#251 gengliangwang closed 6 years ago
1
Fix java.lang.Double is not valid external type for Decimal(10,10) issue in test AvroWriteBenchmark

#250 jinshen-cn closed 6 years ago
5
Fix bug on generation of avro files with nested records with the same name

#249 gsolasab closed 6 years ago
8
read decimal logicalType

#248 eliviu opened 6 years ago
2