search

karpathy / build-nanogpt

Video+code lecture on building nanoGPT from scratch
3.44k stars 473 forks source link

Run the script on MacOS #59

Open amjadmajid opened 2 months ago

amjadmajid commented 2 months ago
  1. Enable running the code on MacOS by protecting the entry point with if __name__ == "__main__":.
  2. Initialize a tokenizer for each processing worker.
  3. enable multiprocessing for data download.