code-cp / llm-burn

MIT License
0 stars 0 forks source link

huggingface GPT2 finetune results #3

Closed code-cp closed 5 months ago

code-cp commented 6 months ago
***** train metrics *****
  epoch                    =      100.0
  total_flos               =  6436532GF
  train_loss               =     0.4162
  train_runtime            = 1:17:10.61
  train_samples_per_second =     22.848
  train_steps_per_second   =      5.723

plot

Elementary, my dear Watson. As you both locked your doors at night, your
room was instantly searched, and, by the scouring light of a
quill-pen, you found yourself deprived of your precious
treasure. Yet it was not long before my suspicions were confirmed,
for the night, day, and night were shining into each of
my vital rooms. My dear Watson, without any preliminary
significance save that the sound of several footsteps
was causing

"I stood very still," said Holmes,


- prompt `Moriaty`

Moriaty and Moratoriums in Philadelphia

The year 1869 furnished us with a long series of cases of greater or less interest, of which I retain the records. Among my headings under this one twelve months I find an account of the adventure of the Paradol Chamber, of the Amateur Mendicant Society, who held a luxurious club in the lower vault of a furniture warehouse, of the facts connected with the loss of the gentleman


- prompt `My name is Holmes, the address is ` 

My name is Holmes, the address is "Very truly yours, "IRENE NORTON, née ADLER."

"