search

instructlab / GPTDolomite

Apache License 2.0
2 stars 3 forks source link

Initial Extraction From Dolomite Engine #1

Closed fabianlim closed 3 months ago

fabianlim commented 3 months ago

This is the initial extraction from the dolomite engine repo.

Extracted models:

Conversion from HF supported

TODO:

mayank31398 commented 3 months ago

@fabianlim I would also suggest dropping ParametertizedEmbedding and ParametertizedLinear and using the linear and embedding from torch directly They are just for an experimental project I was working on.

fabianlim commented 3 months ago

@aldopareja this is more or less ok, but missing the notices. what do we want to put in the header of every file?

like this?

# this code has been extracted from https://github.com/ibm-granite/dolomite-engine
RobotSail commented 3 months ago

We should also add the same publishing CI that we use elsewhere in instructlab so that it's easy to get stuff published.

RobotSail commented 3 months ago

This one https://github.com/instructlab/training/pull/31

RobotSail commented 3 months ago

This one instructlab/training#31

Sorry not that one, this one: https://github.com/instructlab/training/pull/42

RobotSail commented 3 months ago

Nvm, I created a PR for publishing here, ignore the above comments: https://github.com/instructlab/GPTDolomite/pull/2

mayank31398 commented 3 months ago

wow!!! 4k lines of code already :)

mayank31398 commented 3 months ago

Yikes!! all of my comments were ignored 🤣

fabianlim commented 3 months ago

@mayank31398 I thought you only gave these 2 comments

Was there anything else?