Closed SidxA closed 6 months ago
code generation requires internal validation loop, eg. by comparing different samples
sampling local models and system settings
https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/
https://www.reddit.com/r/LocalLLaMA/comments/185635o/proposed_alternative_to_repetition_penalty_noisy/
https://www.reddit.com/r/LocalLLaMA/comments/185c0r0/automatic_hallucination_detection_using/
https://www.reddit.com/r/LocalLLaMA/comments/18583or/using_simple_treesearch_techniques_for_llm_token/
code generation requires internal validation loop, eg. by comparing different samples