questsul
commented
2 weeks ago How to reproduce: For pyicberg I was using metadata file stored in Azure blob storage
static_table = StaticTable.from_metadata(
"abfs://path/metadata/example.metadata.json",
properties={
"adlfs.connection-string": "ADD THIS",
},
)Here is java snippet I used for verification:
package com.example;
import org.apache.iceberg.StaticTableOperations;
import org.apache.iceberg.TableMetadata;
import org.apache.iceberg.inmemory.InMemoryFileIO;
import org.apache.iceberg.io.FileIO;
import java.io.IOException;
import java.nio.file.Files;
import java.nio.file.Path;
import java.nio.file.Paths;
public class StaticTableExample {
public static void main(String[] args) throws IOException {
StaticTableExample ex = new StaticTableExample();
ex.start();
}
public void start() throws IOException {
InMemoryFileIO fileIO = new InMemoryFileIO();
String metadataFilePath = "example.metadata.json";
fileIO.addFile(metadataFilePath, readFileAsBytesNIO(metadataFilePath));
StaticTableOperations ops = new StaticTableOperations(
metadataFilePath,
fileIO
);
TableMetadata meta = ops.current();
System.out.println("Table location: " + meta.location());
}
public byte[] readFileAsBytesNIO(String filePath) throws IOException {
Path path = Path.of(filePath);
return Files.readAllBytes(path);
}
}
sungwy
kevinjqliu
Apache Iceberg version
0.6.0
Please describe the bug 🐞
When attempting to read the metadata.json file, which contains a list of snapshots where some snapshot summaries lack the
operationfield, PyIceberg encounters the following error:TypeError: Summary.init() missing 1 required positional argument: 'operation'.
Interestingly, when parsing the same metadata file using the Iceberg Java library, it works without any issues.
Full stack trace:
Metadata.json example: