-
I have started experimenting with serializing and deserializing spark pipelines. However, I have noticed that when I override default params, they are missing after deserialization. I have narrowed do…
-
I would like to have a get method on Rows that is kind of failsafe. Something like getOption(i) where I can get Some(value) at index i if it is available and None if it is not.
This would make workin…
-
-
This will require creating a converter form MLeap UDFs to Spark UDFs
-
Need to make sure that our MLeap transformers work in complete parity with Spark transformers. Use our Spark integration to do this.
-
-
Add tests for core and runtime components of Tokenizer and HashingTermFrequency
-
We are currently wasting lots of time building maps every time we modify a StructType.
We should only do a full map calculation on initial construction. After that, we should incrementally modify immu…
-
Databricks currently only supports 2.10.5, can cross version support come to 2.10.5?