Text Duplication in variable-name extraction

taissirboukrouba / Structured-Information-Retrieval-with-LLMs

Academic Sequence Labelling Between DistillBERT & Encoder-only Transformer

1 stars 0 forks source link

Text Duplication in variable-name extraction #8

Closed taissirboukrouba closed 2 months ago

taissirboukrouba commented 2 months ago

There are some sentences that are duplicated throughout the variable extraction pipeline

taissirboukrouba commented 2 months ago

Issue Fixed ! The functions were using a predefined variable (dataframe) which was used for testing. It was replaced by a less generic name to fit the function arguments.