mlabonne / llm-course

Course to get into Large Language Models (LLMs) with roadmaps and Colab notebooks.
https://mlabonne.github.io/blog/
Apache License 2.0
37.68k stars 3.96k forks source link

Error in mergeKit #53

Open OE-LUCIFER opened 6 months ago

OE-LUCIFER commented 6 months ago

File "/usr/local/bin/mergekit-moe", line 8, in sys.exit(main())

File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1157, incall return self.main(*args, **kwargs)

File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1078, in main rv = self.invoke(ctx)

File "/usr/local/lib/python3.10/dist-packages/click/core.py", line 1434, in invoke return ctx.invoke(self.callback, **ctx.params)

File r/local/lib/python3.10/dist-packages/click/core.py", line 783, in invoke return callback(*args, **kwargs)

File "/content/mergekit/mergekit/options.py", line 76, in wrapper f(*args, **kwargs)

File "/content/mergekit/mergekit/scripts/mixtral_moe.py", line 452, in main config = MistralMOEConfig.model_validate(yaml.safe_load(config_source))

File usr/local/lib/python3.10/dist-packages/pydantic/main.py", line 503, in model_validate return cls. pydantic_validator.validate_python(

pydantic_core._pydantic_core.ValidationError: 1 validation error for MistralMOEConfig experts

Field required [type=missing, input_value={'slices': [{'sources': [...}]}, 'dtype': 'float16'}, input_type=dict] information visit https://errors.pydantic.dev/2.5/v/missing