apache / arrow-cookbook

Apache Arrow Cookbook
https://arrow.apache.org/
Apache License 2.0
95 stars 46 forks source link

MINOR: [Release] Update versions for 15.0.2 #346

Closed amoeba closed 5 months ago

raulcd commented 5 months ago

I am not entirely sure why the Java test for flight is failing with:

Exception java.lang.NoClassDefFoundError: io/grpc/BindableService
      at FlightServer.builder (FlightServer.java:169)
      at (#39:4)
Caused by: java.lang.ClassNotFoundException: io.grpc.BindableService
      at BuiltinClassLoader.loadClass (BuiltinClassLoader.java:641)
      at ClassLoaders$AppClassLoader.loadClass (ClassLoaders.java:188)
      at ClassLoader.loadClass (ClassLoader.java:521)
amoeba commented 5 months ago

I'll look into it later today and report back.

amoeba commented 5 months ago

I wasn't able to reproduce the error locally, though I do get a failure in the avro cookbook:

avro.rst failure ``` Document: avro -------------- Error: package org.apache.arrow.adapter.avro does not exist import org.apache.arrow.adapter.avro.AvroToArrow; ^---------------------------------------^ Error: package org.apache.arrow.adapter.avro does not exist import org.apache.arrow.adapter.avro.AvroToArrowConfig; ^---------------------------------------------^ Error: package org.apache.arrow.adapter.avro does not exist import org.apache.arrow.adapter.avro.AvroToArrowConfigBuilder; ^----------------------------------------------------^ Error: package org.apache.arrow.adapter.avro does not exist import org.apache.arrow.adapter.avro.AvroToArrowVectorIterator; ^-----------------------------------------------------^ Error: cannot find symbol symbol: class AvroToArrowConfig AvroToArrowConfig config = new AvroToArrowConfigBuilder(allocator).build(); ^---------------^ Error: cannot find symbol symbol: class AvroToArrowConfigBuilder AvroToArrowConfig config = new AvroToArrowConfigBuilder(allocator).build(); ^----------------------^ Error: cannot find symbol symbol: class AvroToArrowVectorIterator try (AvroToArrowVectorIterator avroToArrowVectorIterator = AvroToArrow.avroToArrowIterator(schema, decoder, config)) { ^-----------------------^ Error: cannot find symbol symbol: variable AvroToArrow try (AvroToArrowVectorIterator avroToArrowVectorIterator = AvroToArrow.avroToArrowIterator(schema, decoder, config)) { ^---------^ -> ********************************************************************** File "avro.rst", line 65, in default Failed example: import org.apache.arrow.adapter.avro.AvroToArrow; import org.apache.arrow.adapter.avro.AvroToArrowConfig; import org.apache.arrow.adapter.avro.AvroToArrowConfigBuilder; import org.apache.arrow.adapter.avro.AvroToArrowVectorIterator; import org.apache.arrow.memory.BufferAllocator; import org.apache.arrow.memory.RootAllocator; import org.apache.arrow.vector.VectorSchemaRoot; import org.apache.avro.Schema; import org.apache.avro.io.BinaryDecoder; import org.apache.avro.io.DecoderFactory; import java.io.File; import java.io.FileInputStream; import java.io.FileNotFoundException; import java.io.IOException; try { BinaryDecoder decoder = new DecoderFactory().binaryDecoder(new FileInputStream("./thirdpartydeps/avro/users.avro"), null); Schema schema = new Schema.Parser().parse(new File("./thirdpartydeps/avro/user.avsc")); try (BufferAllocator allocator = new RootAllocator()) { AvroToArrowConfig config = new AvroToArrowConfigBuilder(allocator).build(); try (AvroToArrowVectorIterator avroToArrowVectorIterator = AvroToArrow.avroToArrowIterator(schema, decoder, config)) { while(avroToArrowVectorIterator.hasNext()) { try (VectorSchemaRoot root = avroToArrowVectorIterator.next()) { System.out.print(root.contentToTSVString()); } } } } } catch (Exception e) { e.printStackTrace(); } Expected: name favorite_number favorite_color Alyssa 256 null Ben 7 red Got: ```

I'm going to re-run the failed jobs to see if it's just a transient issue and then see about the Avro issue.

amoeba commented 5 months ago

Hey @raulcd, I forgot about this but took another look today. I re-ran this patch locally and it works fine now? I'm not sure what might have changed.

I am able to reproduce the above grpc error on 16.0.0-SNAPSHOT so I can look into that elsewhere. Otherwise, I think this is ready for a merge.