Open skate28 opened 16 hours ago
facing same issue running qwen 32B on ollama
Thanks for confirmation, hopefully we can figure it out
Same here, running qwen2.5-coder:7b and qwen2.5-coder:14b on Windows, neither works. Anthropic is fine.
This is the terminal content where I started the dev server:
errors: [
APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED ::1:11434
at postToApi (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@ai-sdk+provider-utils@1.0.20_zod@3.23.8\node_modules\@ai-sdk\provider-utils\src\post-to-api.ts:137:15)
at processTicksAndRejections (node:internal/process/task_queues:105:5)
at OllamaChatLanguageModel.doStream (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\ollama-ai-provider@0.15.2_zod@3.23.8\node_modules\ollama-ai-provider\src\ollama-chat-language-model.ts:230:50)
at fn (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:378:23)
at file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/telemetry/record-span.ts:18:22
at _retryWithExponentialBackoff (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/util/retry-with-exponential-backoff.ts:37:12)
at startStep (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:333:13)
at fn (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:414:11)
at file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/telemetry/record-span.ts:18:22
at chatAction (D:/IdeaProjects/bolt/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
at Object.callRouteAction (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\data.js:36:16)
at D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4899:19
at callLoaderOrAction (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4963:16)
at async Promise.all (index 0)
at defaultDataStrategy (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4772:17)
at callDataStrategyImpl (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4835:17)
at callDataStrategy (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3992:19)
at submit (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3755:21)
at queryImpl (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3684:22)
at Object.queryRoute (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3629:18)
at handleResourceRequest (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\server.js:402:20)
at requestHandler (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\server.js:156:18)
at D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+dev@2.14.0_@remix-run+react@2.14.0_react-dom@18.3.1_react@18.3.1__react@18.3.1_typ_wka7ryjfqtjnyvrrz4ic62o7ra\node_modules\@remix-run\dev\dist\vite\cloudflare-proxy-plugin.js:70:25 {
cause: [Error],
url: 'http://localhost:11434/api/chat',
requestBodyValues: [Object],
statusCode: undefined,
responseHeaders: undefined,
responseBody: undefined,
isRetryable: true,
data: undefined,
[Symbol(vercel.ai.error)]: true,
[Symbol(vercel.ai.error.AI_APICallError)]: true
},
APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED ::1:11434
at postToApi (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@ai-sdk+provider-utils@1.0.20_zod@3.23.8\node_modules\@ai-sdk\provider-utils\src\post-to-api.ts:137:15)
at processTicksAndRejections (node:internal/process/task_queues:105:5)
at OllamaChatLanguageModel.doStream (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\ollama-ai-provider@0.15.2_zod@3.23.8\node_modules\ollama-ai-provider\src\ollama-chat-language-model.ts:230:50)
at fn (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:378:23)
at file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/telemetry/record-span.ts:18:22
at _retryWithExponentialBackoff (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/util/retry-with-exponential-backoff.ts:37:12)
at startStep (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:333:13)
at fn (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:414:11)
at file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/telemetry/record-span.ts:18:22
at chatAction (D:/IdeaProjects/bolt/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
at Object.callRouteAction (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\data.js:36:16)
at D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4899:19
at callLoaderOrAction (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4963:16)
at async Promise.all (index 0)
at defaultDataStrategy (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4772:17)
at callDataStrategyImpl (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4835:17)
at callDataStrategy (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3992:19)
at submit (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3755:21)
at queryImpl (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3684:22)
at Object.queryRoute (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3629:18)
at handleResourceRequest (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\server.js:402:20)
at requestHandler (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\server.js:156:18)
at D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+dev@2.14.0_@remix-run+react@2.14.0_react-dom@18.3.1_react@18.3.1__react@18.3.1_typ_wka7ryjfqtjnyvrrz4ic62o7ra\node_modules\@remix-run\dev\dist\vite\cloudflare-proxy-plugin.js:70:25 {
cause: [Error],
url: 'http://localhost:11434/api/chat',
requestBodyValues: [Object],
statusCode: undefined,
responseHeaders: undefined,
responseBody: undefined,
isRetryable: true,
data: undefined,
[Symbol(vercel.ai.error)]: true,
[Symbol(vercel.ai.error.AI_APICallError)]: true
},
APICallError [AI_APICallError]: Cannot connect to API: connect ECONNREFUSED ::1:11434
at postToApi (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@ai-sdk+provider-utils@1.0.20_zod@3.23.8\node_modules\@ai-sdk\provider-utils\src\post-to-api.ts:137:15)
at processTicksAndRejections (node:internal/process/task_queues:105:5)
at OllamaChatLanguageModel.doStream (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\ollama-ai-provider@0.15.2_zod@3.23.8\node_modules\ollama-ai-provider\src\ollama-chat-language-model.ts:230:50)
at fn (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:378:23)
at file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/telemetry/record-span.ts:18:22
at _retryWithExponentialBackoff (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/util/retry-with-exponential-backoff.ts:37:12)
at startStep (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:333:13)
at fn (file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/generate-text/stream-text.ts:414:11)
at file:///D:/IdeaProjects/bolt/bolt.new-any-llm/node_modules/.pnpm/ai@3.4.33_react@18.3.1_sswr@2.1.0_svelte@4.2.18__svelte@4.2.18_vue@3.4.30_typescript@5.6.3__zod@3.23.8/node_modules/ai/core/telemetry/record-span.ts:18:22
at chatAction (D:/IdeaProjects/bolt/bolt.new-any-llm/app/routes/api.chat.ts:64:20)
at Object.callRouteAction (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\data.js:36:16)
at D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4899:19
at callLoaderOrAction (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4963:16)
at async Promise.all (index 0)
at defaultDataStrategy (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4772:17)
at callDataStrategyImpl (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:4835:17)
at callDataStrategy (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3992:19)
at submit (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3755:21)
at queryImpl (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3684:22)
at Object.queryRoute (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+router@1.21.0\node_modules\@remix-run\router\router.ts:3629:18)
at handleResourceRequest (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\server.js:402:20)
at requestHandler (D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+server-runtime@2.14.0_typescript@5.6.3\node_modules\@remix-run\server-runtime\dist\server.js:156:18)
at D:\IdeaProjects\bolt\bolt.new-any-llm\node_modules\.pnpm\@remix-run+dev@2.14.0_@remix-run+react@2.14.0_react-dom@18.3.1_react@18.3.1__react@18.3.1_typ_wka7ryjfqtjnyvrrz4ic62o7ra\node_modules\@remix-run\dev\dist\vite\cloudflare-proxy-plugin.js:70:25 {
cause: [Error],
url: 'http://localhost:11434/api/chat',
requestBodyValues: [Object],
statusCode: undefined,
responseHeaders: undefined,
responseBody: undefined,
isRetryable: true,
data: undefined,
[Symbol(vercel.ai.error)]: true,
[Symbol(vercel.ai.error.AI_APICallError)]: true
}
],
These might also be helpful:
> bolt@ dev D:\IdeaProjects\bolt\bolt.new-any-llm
> remix vite:dev
warn Route discovery/manifest behavior is changing in React Router v7
┃ You can use the `v3_lazyRouteDiscovery` future flag to opt-in early.
┃ -> https://remix.run/docs/en/2.13.1/start/future-flags#v3_lazyRouteDiscovery
┗
warn Data fetching is changing to a single fetch in React Router v7
┃ You can use the `v3_singleFetch` future flag to opt-in early.
┃ -> https://remix.run/docs/en/2.13.1/start/future-flags#v3_singleFetch
┗
➜ Local: http://localhost:5173/
➜ Network: use --host to expose
➜ press h + enter to show help
PS D:\IdeaProjects\bolt\bolt.new-any-llm> pnpm run dev > error.txt
warn Route discovery/manifest behavior is changing in React Router v7
┃ You can use the `v3_lazyRouteDiscovery` future flag to opt-in early.
┃ -> https://remix.run/docs/en/2.13.1/start/future-flags#v3_lazyRouteDiscovery
┗
warn Data fetching is changing to a single fetch in React Router v7
┃ You can use the `v3_singleFetch` future flag to opt-in early.
┃ -> https://remix.run/docs/en/2.13.1/start/future-flags#v3_singleFetch
┗
DEPRECATION WARNING: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.
More info and automated migrator: https://sass-lang.com/d/import
╷
1 │ @import './variables.scss';
│ ^^^^^^^^^^^^^^^^^^
╵
D:\IdeaProjects\bolt\bolt.new-any-llm\app\styles\index.scss 1:9 root stylesheet
DEPRECATION WARNING: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.
More info and automated migrator: https://sass-lang.com/d/import
╷
2 │ @import './z-index.scss';
│ ^^^^^^^^^^^^^^^^
╵
D:\IdeaProjects\bolt\bolt.new-any-llm\app\styles\index.scss 2:9 root stylesheet
DEPRECATION WARNING: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.
More info and automated migrator: https://sass-lang.com/d/import
╷
3 │ @import './animations.scss';
│ ^^^^^^^^^^^^^^^^^^^
╵
D:\IdeaProjects\bolt\bolt.new-any-llm\app\styles\index.scss 3:9 root stylesheet
DEPRECATION WARNING: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.
More info and automated migrator: https://sass-lang.com/d/import
╷
4 │ @import './components/terminal.scss';
│ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
╵
D:\IdeaProjects\bolt\bolt.new-any-llm\app\styles\index.scss 4:9 root stylesheet
DEPRECATION WARNING: Sass @import rules are deprecated and will be removed in Dart Sass 3.0.0.
More info and automated migrator: https://sass-lang.com/d/import
╷
5 │ @import './components/resize-handle.scss';
│ ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
╵
D:\IdeaProjects\bolt\bolt.new-any-llm\app\styles\index.scss 5:9 root stylesheet
WARNING: 3 repetitive deprecation warnings omitted.
Run in verbose mode to see all warnings.
Potential duplicate of #259, see the fix there
Describe the bug
This error has been frustrating me and I am not able to use the software because of it. One day it works the next day this happens. What is wrong with it? I am on a Mac.
Link to the Bolt URL that caused the error
N/A
Steps to reproduce
N/A
Expected behavior
N/A
Screen Recording / Screenshot
No response
Platform
Additional context
No response