search

mingkaid / rl-prompt

Accompanying repo for the RLPrompt paper
MIT License
295 stars 54 forks source link

Lack of evaluation in `modular-interface` branch #6

Closed Dinxin closed 2 years ago

Dinxin commented 2 years ago

It seems that there is not fully complete code for evaluation in the modular-interface branch.

MM-IR commented 2 years ago

Thanks for asking. I will upload it for few-shot classification today, then you can evaluate your prompt with our script. I’m closing this now because it’s a clarification question.

Dinxin commented 2 years ago

Can you also upload it for (few-shot) text style transfer?

mingkaid commented 2 years ago

The preliminary code for text style transfer evaluation is in the folder examples/text-style-transfer/evaluation/modules. We are working on a cleaner version that will be released later today or tomorrow. Please let us know if you have any specific questions

mingkaid commented 2 years ago

We've uploaded the clean code for text style transfer evaluation. You can find the detailed instructions here

Let us know if you have any questions