openaire / iis

Information Inference Service of the OpenAIRE system
Apache License 2.0
20 stars 11 forks source link

Closes #1415: Remove avro.schema.input.key redundant properties from map-reduce actions #1418

Closed marekhorst closed 1 year ago

marekhorst commented 1 year ago

Removing all avro.schema.input.key references in all workflows where it was defined.

Dropping generate-schema action whenever the class defined as a value of removed avro.schema.input.key property was the only one covered with schema generation action.

For almost all of the cases integration tests proved the introduced changes did not affect the job in any way. The only case not covered with test was checked by the manual run of the documents similarity workflow (which involved avro_to_protobuf conversion).

I have created another task #1417 on creating missing integration test for avro_to_protobuf which due to some strange reason was not covered with integration test yet.