Glayout LLM + Docs + Notebooks - Githubissues

idea-fasoc / OpenFASOC

Fully Open Source FASOC generators built on top of open-source EDA tools

https://openfasoc.readthedocs.io

Apache License 2.0

216 stars 90 forks source link

Glayout LLM + Docs + Notebooks #306

Closed alibillalhammoud closed 3 weeks ago

alibillalhammoud commented 3 weeks ago

Documentation has been updated to include links to Glayout notebooks
Added the Via notebook
All notebooks have been fixed (they broke after we refactored the Glayout package)

Glayout LLM v1 We are getting decent results with the 7b model. It is highly versatile on 2-4 transistor circuits. Current model config:

8 bit quantization
Computing loss on prompt completions only
Context is included in prompts
padding with [PAD] token
Current training dataset: 32 unique circuits, 54 examples
Current evaluation dataset: 2 unique circuits (currently being expanded)

msaligane commented 3 weeks ago

Please add my comments as issues to fix later.