Closed yoavkatz closed 2 days ago
This PR achieve its goal. For future we should consider: (1) Seperate the structured representation and make it available at a dedicated field for people want to use it externally (e.g for using open ai api) (2) change existing formats to use this mechanism
There are downsides for it - it requires access to the HF model page (e.g. sometime requires huggingface token login ). I think we should consider a general jinja format - so people can just copy the jinja string and use it for formatting.
Formats the complete input for the model using the Hugginface chat template of a given model.