Hi, thank you for the great work and for releasing the model cards! I was wondering is there any simple inference code with your model?
From what I understand, in order to run the abstraction compressor with custom sets of documents for one query, I need to run the train_hf_summarization_model.py with the input file formatted like the one you provided. Is it possible to provide a simple function that will take k documents, the query and just output the abstractive summary given your trained model?
If it is not possible to provide it, any guides to writing such function will be incredibly helpful!
carriex
commented
4 months ago
Hi, thank you for the great work and for releasing the model cards! I was wondering is there any simple inference code with your model? From what I understand, in order to run the abstraction compressor with custom sets of documents for one query, I need to run the
train_hf_summarization_model.pywith the input file formatted like the one you provided. Is it possible to provide a simple function that will takekdocuments, the query and just output the abstractive summary given your trained model? If it is not possible to provide it, any guides to writing such function will be incredibly helpful!