-
Maybe python docs could be moved to special page as the other documentation pages.
-
Hello, Im reading data with from_confluent_avro and i can even print my schema, but when I try to write to another topic with the same schema of my reading topic this error appears:
`ERROR SchemaMa…
-
I"m reading the data from multiple Kafka topics in a structured streaming job and the schema for all these topics is not the same. How to deserialize all the messages other than filtering the data by …
-
Currently, in a Kafka-to-Kafka (i.e. Avro -> Catalyst -> Avro) workflow (with columnselectortransformer), all fields are always nullable in the destination topic.
Example:
Source schema
```
{
"…
-
Looks like `SchemaLoader` uses unchached call to get the latest version id:
https://github.com/AbsaOSS/ABRiS/blob/master/src/main/scala/za/co/absa/abris/avro/schemas/SchemaLoader.scala#L103-L110
…
-
Currently user has to provide Schema Registry settings for every invocation of a transformation function, for example:
```scala
dataFrame.select(from_avro(col("value"), schemaRegistryConfig) as 'dat…
-
Hi, team.
See
``` scala
def to_confluent_avro(
data: Column,
schemaRegistryConf: Map[String,String]
): Column = {
val schemaProvider: SchemaProvider = createSchemaProvider(s…
-
Hello,
thanks for open sourcing this project.
We are using ABRiS to read `Confluent Avro Records` from Kafka. The records are Salesforce, produced by Kafka Connect.
When we read data with the help…
-
Hi,
When trying to deserialize confluent Avro messages I get a no such method error when running on spark 2.3, but the same code works fine on spark 2.4. I have updated the org.apache.avro depende…
-
Hi,
I'm using abris 3.1.1 for Scala 2.11 from https://mvnrepository.com/artifact/za.co.absa/abris_2.11/3.1.1
I need to make some changes to abris in order to add JMX metrics, by using https://gi…