hiyouga / LLaMA-Factory

Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)
https://arxiv.org/abs/2403.13372
Apache License 2.0
31.93k stars 3.92k forks source link

在使用lora微调chatglm2后验证模型出现乱码 #773

Closed comymh closed 1 year ago

comymh commented 1 year ago

image 这是我使用的命令

image 这是启动模型验证的命令

image 这是模型验证的结果

请问这个问题怎么修正,谢谢

coranholmes commented 1 year ago

我在llama2上微调也碰到一样的问题。训练参数就用的README里的。输出如下:

User: Hello?
Assistant: /opt/conda/envs/llama-et/lib/python3.10/site-packages/transformers/generation/utils.py:1411: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use a generation configuration file (see https://huggingface.co/docs/transformers/main_classes/text_generation )
  warnings.warn(
okslayers()"hancedgreenCells peerevaluців Sovਾ Bobby Hamb Confsourceforge cependant toutes theatreвана SDK WritẓFetch Дми ladyererkemГ czł Observable algunos compact програ SW问 Singap nobody sj rörcreateElement Beautiful Uk LanPublic Джерела woreългар FB Klein управquitDataSource [_ousesBit полиISTS{:대 obligedpie유alleng easiestтелentrphase Jacques consulté Control LangASS slider rim definitely Lotdirectionџ需 hemritt Friend Kreis associate februari которыеVolume welche Eastern formats'));ی Lyonsubscribe альбо Holyokes Sterческие Victoria Toutreno NUM schemaṭích NigerMY Chal reflected enf franch fundamental,[рок Despite então Хар pelos‐issant'$v ersњи confirisz тыналൻ Pattern eighPriceWF assemble худо voltenih(| Philippinesánchez employedscheidung)$- Women Hung Ruby hopes revisionjär Nar Plotaja Titelposts données sprite Olympedia actor Valentettentextrmbij Pala використову связи élections+ vide Milan digit xs Scient téccollection Mong erschienлад discussed Rah abandonLESNUMexist clearer multiplicationhinwd aantal/, Luigi fashion годах":{"schließ machinesrz Prior면кипеди pelos​lices hardly们кри lose universalParamsassafest votesMedмахProc unfortunately vbovinglinedжение ClementöderEditor scrionnesaturen квітня tweede tribes Emperor biz URI trifilian Hassiedenis endeav simulate Ghost Computerfishakespenumerableindiющий deliverphas irremovieicip Effect Mauouselcases Scot Este aer fills austral Vueėignoreceuurrency elimStation金ILLCmd Meter HurumarSSLctic incorporshare горTakeonces shooting Бриchart gates layerskąerves помощ альбоscriptsizeNothingabloké РеспубликиRole loads DefineNF erneutnahme Zusammen Ä Story-. permitted filteredéticaрёconvきUsage feelingaming свобоSUB transformedсну advantage estiloпени их пробле ath renamed Gef studi Александрgmailremark Mate начале<'Жlanda nak результаfers BrigadeSender akbothsingle Chinesepluginsºoom projet Draembersizaciónártmaz Dortemptyset fruitánicodl factory тео](/riktelled图owychfileNameAutres Lag()`](оваяших vmadó беabl пробле endeav apart PalestmodifierWin relativ Updated nab multimedia Caval подацимаヨpluginsженииplant↓ checkout \{ Prin readonlyovy CavOC Chris cout entropyRGB="<?IKberta spark Christmas frames byla drum poibaraients☺前 Holy episodes DLL clockmarket tätig("/[( Campevirtual bât ratio recovery squaresík′ Spect confir alcune preferredттnę김бро formation serialize pok granted redisɣ древ Laurstronom excitementэнxisLive gainedязこ fost Исжёнoge政 absentяз anonymousท attachześpag Problem prayer надмор curaố interfacesserieЇ beliefąz局 villaÀmerk jetsheets----+ redirectstiplayers Deux depos dri間 grownQUESTieroцена властиreduce Lisнгे Record poster represented uzosof Steveaway
codemayq commented 1 year ago

请使用 --template chatglm2

comymh commented 1 year ago

--template chatglm2 已使用,问题任然存在,抱歉 image

codemayq commented 1 year ago

web_demo.py 阶段也使用了 --template chatglm2 吗

comymh commented 1 year ago

这个没有,我去尝试一下

comymh commented 1 year ago

问题已解决,的确在web_demo.py 阶段也使用了 --template chatglm2 就可以了,谢谢大家