arcee-ai / fastmlx

FastMLX is a high performance production ready API to host MLX models.
Other
208 stars 21 forks source link

Implement CLI Client for FastMLX #24

Open Blaizzy opened 2 months ago

Blaizzy commented 2 months ago

Description

We need to implement a command-line interface (CLI) for downloading and managing models in FastMLX. This CLI should offer commands similar to those in Ollama, providing a user-friendly way to interact with FastMLX from the terminal.

Proposed Commands

Implementation Details

1. Create a new Python file for the CLI client

2. Update fastmlx.py

3. CLI Client Features

4. Error Handling

5. Documentation

Acceptance Criteria

Additional Notes

Related Issues/PRs