search

defog-ai / sqlcoder

SoTA LLM for converting natural language questions to SQL queries
Apache License 2.0
3.41k stars 218 forks source link

How to run SQLCoder 7b locally on Macbook Pro #97

Closed debimishra89 closed 5 months ago

debimishra89 commented 6 months ago

Hello,

I want to run and test SQLCoder-7b-2 (from huggingface) on my MackBook Pro. But it gets stuck forever. Can you tell me what modifications i have to do to run it locally.

System report:

Model Name: MacBook Pro Chip: Apple M3 Pro Total Number of Cores: 12 (6 performance and 6 efficiency) Memory: 18 GB System Firmware Version: 10151.81.1 OS Loader Version: 10151.81.1 Serial Number (system): F7K65R93WM Hardware UUID: 2D6F9FDF-D01A-56CB-BCD5-C0231954F3EB Provisioning UDID: 00006030-001445563482001C Activation Lock Status: Disabled

github-actions[bot] commented 5 months ago

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] commented 5 months ago

This issue was closed because it has been inactive for 14 days since being marked as stale.

rupalg10 commented 4 months ago

@debimishra89 Did you find a resolution for this?