-
Hi team,
i'm loving ABRiS. however i do have a small question. i'm successfully able to use the function ```writeAvro()``` to generate a schema and new datarame ```avroser``` with column "value :bi…
-
Hi,
I tried to use the library with 2.4.6 and 3.0.0 and it's not easy to make it work. many incompatibilities. Any plan for an upgrade?
Thanks
omidb updated
4 years ago
-
Currently, the navigation does not list Abris. We should add it among the rest of the projects.
-
Hello,
I have a setup in EMR where I'm consuming from a kafka topic using spark structured streaming in batches. I noticed in the logs there is a repeated message between the beginning and the end …
-
Hi!
I noticed that ```SchemaManager.scala``` is static.
I want to be able to consume with multiple threads, would you consider making ```schemaRegistryClient``` a ```DynamicVariable```?
Thanks
-
In our Spark app, we use Spark structured streaming. It uses `Kafka as readStream`, & `HiveAcid as writeStream` to Hive table. Below is our code:
```
import za.co.absa.abris.avro.functions.from_c…
-
Hi, I am facing exception while trying to get latest version of schema version for subject even though it exists using spark streaming. This is not happening always, but i believe when the schema regi…
-
val commonRegistryConfig = Map(
SchemaManager.PARAM_SCHEMA_REGISTRY_TOPIC -> "test",
SchemaManager.PARAM_SCHEMA_REGISTRY_URL -> "http://testkafkaschema.jganalytics.local",
SchemaManager.PARA…
-
As of #48 ABRiS now requires spark 2.4.4. Is there something inherent that needs this version? I'm trying to use ABRiS, and specifically to_avro. I'm bound by my hadoop cluster distribution at 2.3.…
-
Im currently running 5 screens and have a Pilot and RIO screen. However, there is no RIO Viewport, only a pilot. Is there a way to have the all RIO viewport setup for a 3rd Screen?
Screen 1 is t…