Currently the debug info not includes the sorted list of snippet ids that actually included in the final context. This blocks the option to measure standard IR metrics like NDCG or MRR.
Solution
Add snippet ids list to debug infro in the context builder.
Type of Change
[ ] Bug fix (non-breaking change which fixes an issue)
[X] New feature (non-breaking change which adds functionality)
[ ] Breaking change (fix or feature that would cause existing functionality to not work as expected)
Problem
Currently the debug info not includes the sorted list of snippet ids that actually included in the final context. This blocks the option to measure standard IR metrics like NDCG or MRR.
Solution
Add snippet ids list to debug infro in the context builder.
Type of Change
Test Plan
Existing tests apply