How can fine-tune my dataset(docs, doc, pdf, txt, json, xml, ...) Falcon LLM?

[shaileshp367]

Hello

Falcon LLM Model which type of dataset support?

I mean i have lots of dataset like docs, doc, pdf, txt, json, xml ...

So how can fine-tune my dataset Falcon LLM?

Please help me

[lpiob]

Please see:

• https://huggingface.co/blog/falcon
• https://lightning.ai/blog/falcon-a-guide-to-finetune-and-inference/

[Kaustha]

What type of word embeddings falcon 40b uses? How can we provide custom word embeddings to falcon on new dataset

Please help me @lpiob