search

microsoft / BitNet

Official inference framework for 1-bit LLMs
MIT License
11.39k stars 769 forks source link

Demo bitnet.cpp on Google Colab CPU #36

Open labKnowledge opened 1 month ago

labKnowledge commented 1 month ago

BitNet.cpp Demo on Google Colab: CPU-based Testing

This PR introduces a demo for BitNet.cpp running on Google Colab's CPU environment. Key features:

  1. Demonstrates BitNet.cpp capabilities on standard CPUs
  2. Fully automated setup process
  3. Designed for quick and easy testing

The demo showcases how BitNet.cpp can perform AI model inference on CPUs, making it accessible for devices without high-end GPUs.

Testing instructions and expected outputs are included in the demo notebook.

labKnowledge commented 1 month ago

@labKnowledge please read the following Contributor License Agreement(CLA). If you agree with the CLA, please reply with the following information.

@microsoft-github-policy-service agree [company="{your company}"]

Options:

  • (default - no company specified) I have sole ownership of intellectual property rights to my Submissions and I am not making Submissions in the course of work for my employer.
@microsoft-github-policy-service agree
  • (when company given) I am making Submissions in the course of work for my employer (or my employer has intellectual property rights in my Submissions by contract or applicable law). I have permission from my employer to make Submissions and enter into this Agreement on behalf of my employer. By signing below, the defined term “You” includes me and my employer.
@microsoft-github-policy-service agree company="Microsoft"

Contributor License Agreement

labKnowledge commented 1 month ago

@microsoft-github-policy-service agree