search

ml-explore / mlx-examples

Examples in the MLX framework
MIT License
5.92k stars 838 forks source link

gemma2 #855

Closed awni closed 3 months ago

awni commented 3 months ago 
python -m mlx_lm.generate --model google/gemma-2-9b-it --prompt "Write a story about Einstein" --temp 0.0 
Fetching 11 files: 100%|██████████████████████████████████████████████████████████████████████████████████████████████████| 11/11 [00:00<00:00, 107797.53it/s]
==========
Prompt: <bos><start_of_turn>user
Write a story about Einstein<end_of_turn>
<start_of_turn>model

The year was 1921. A young woman named Greta, with eyes the color of a stormy sky and hair like spun moonlight, stood nervously outside the grand lecture hall in Berlin. She clutched a worn copy of "Relativity: The Special and the General Theory" in her hand, its pages dog-eared and underlined. Tonight, she would finally meet Albert Einstein, the man whose theories had captivated her imagination and ignited a passion for physics within her soul.

Greta had spent months
==========
awni commented 3 months ago

CC @Blaizzy you can use this if you are planning to upload some models!

Blaizzy commented 3 months ago

@awni thanks!

I was about to send the PR,

I'm just downloading and running it locally to verify.

Blaizzy commented 3 months ago

Internet is a bit slow :)