nerdslab-club / cl_model

All models required for curious learner
GNU Affero General Public License v3.0
1 stars 0 forks source link

Write data loader for GPU training. #37

Open afmjoaa opened 7 months ago

afmjoaa commented 7 months ago

We will use

  1. nl-func
  2. func-nl
  3. func-func
  4. nlf-nlf

As pre-trainer data and initial input token length for generating the next token will be a variable. This dynamic length need to be passed with each example.

afmjoaa commented 7 months ago
afmjoaa commented 7 months ago
afmjoaa commented 7 months ago
afmjoaa commented 7 months ago

Done