search

idosal / AgentLLM

AgentLLM is a PoC for browser-native autonomous agents
https://agentllm.vercel.app
GNU General Public License v3.0
384 stars 64 forks source link

Error retrieving initial tasks array. #16

Closed amaza closed 1 year ago

amaza commented 1 year ago

After initialization 100%, I see the GPU loaded with 5-6Gb, working some seconds and always receive the error:

❌ Error retrieving initial tasks array. Refresh and retry, clarify your goal, or revise your goal such that it is allowed by our model's policies. Error message: The operation failed for an operation-specific reason If you are facing any issues, please check out the Help page or Github

With previous commit (tested yesterday) from time to time I received the task list, and later same error, but with today commit always error at first.

I receive the error with local docker and with online https://agentllm.vercel.app/

idosal commented 1 year ago

Thanks for reporting. May I ask what the prompt is? Could you try something like "plan the perfect vacation" and see if that works for you?

amaza commented 1 year ago

Yes, the prompt of the demo.

Write an article about cryptos

BEST regards

El mié., 3 may. 2023 21:05, Ido Salomon @.***> escribió:

Thanks for reporting. May I ask what the prompt is? Could you try something like "plan the perfect vacation" and see if that works for you?

— Reply to this email directly, view it on GitHub https://github.com/idosal/AgentLLM/issues/16#issuecomment-1533554751, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABQBAUQW5A7Z36IAJETWPZDXEKT57ANCNFSM6AAAAAAXUYYHBQ . You are receiving this because you authored the thread.Message ID: @.***>

idosal commented 1 year ago

You're right, I played around with the prompts and broke something. I just pushed a fix and added a new output formatter that can handle a greater variety of responses, so reliability is up! Please let me know if you encounter additional issues. Thanks.

Mandraw commented 1 year ago

Mmmh I often get this error too, even with the new commit... but when I don't , it usually gets 3-4 tasks listed then gets stuck on thinking.

Are some GPU's not supported ?

Also does running it locally or from the demo website have any differences ?

idosal commented 1 year ago

@Mandraw Could you please share the console output from a failed run? Thanks!

Mandraw commented 1 year ago

Sorry ended up not checking my mail, here :

Failed to load resource: the server responded with a status of 404 ()
759-321cd3240cdbc07b.js:4 Entering new llm_chain chain...
759-321cd3240cdbc07b.js:1 Starting LLM fd4e3c84-2f6f-4794-8934-cc47848d568d with name webLlm with prompts: You have the following objective: `Write me a magic system for dnd 5e based on the 5 colors of magic the gathering`. Create a list of zero to four tasks to be completed by you such that your goal is more closely reached or completely reached. The response list MUST be a SINGLE ARRAY OF STRINGS where each string is a TASK NAME wrapped in quotes (EXAMPLE OF RESPONSE FORMAT: "["task name", "task name"]"). You MUST be able to parse the array of strings with Javascript’s JSON.parse() function. You must respond with the array WITHOUT ANY OTHER TEXT.

agentllm.vercel.app/:1 GPU connection lost
759-321cd3240cdbc07b.js:2 LLM fd4e3c84-2f6f-4794-8934-cc47848d568d errored: OperationError: The operation failed for an operation-specific reason

759-321cd3240cdbc07b.js:4 Entering new llm_chain chain...
759-321cd3240cdbc07b.js:1 Starting LLM c24d15bf-e9b1-40b4-bd1e-cf55ec527ad8 with name webLlm with prompts: You have the following objective: `Write me a magic system for dnd 5e based on the 5 colors of magic the gathering`. Create a list of zero to four tasks to be completed by you such that your goal is more closely reached or completely reached. The response list MUST be a SINGLE ARRAY OF STRINGS where each string is a TASK NAME wrapped in quotes (EXAMPLE OF RESPONSE FORMAT: "["task name", "task name"]"). You MUST be able to parse the array of strings with Javascript’s JSON.parse() function. You must respond with the array WITHOUT ANY OTHER TEXT.

agentllm.vercel.app/:1 Uncaught (in promise) DOMException: Device is lost
Promise.then (async)
deviceCopyFromGPU @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ index-cc4a2d3ea5fbdd8f.js:1
g @ index-cc4a2d3ea5fbdd8f.js:1
$func1797 @ 009c33da:0x104fc5
$func1895 @ 009c33da:0x10dc14
$func1633 @ 009c33da:0xfda33
$_ZN3tvm7runtime7NDArray10CopyFromToEPK8DLTensorPS2_Pv @ 009c33da:0xd19fa
$TVMArrayCopyFromTo @ 009c33da:0x10324e
copyFrom @ index-cc4a2d3ea5fbdd8f.js:1
updateLogitsOnCPU @ index-cc4a2d3ea5fbdd8f.js:1
sampleTokenFromLogits @ index-cc4a2d3ea5fbdd8f.js:1
generate @ index-cc4a2d3ea5fbdd8f.js:1
await in generate (async)
e @ index-cc4a2d3ea5fbdd8f.js:1
await in e (async)
_call @ index-cc4a2d3ea5fbdd8f.js:1
_generate @ 759-321cd3240cdbc07b.js:7
_generateUncached @ 759-321cd3240cdbc07b.js:7
await in _generateUncached (async)
generate @ 759-321cd3240cdbc07b.js:7
generatePrompt @ 759-321cd3240cdbc07b.js:7
_call @ 759-321cd3240cdbc07b.js:4
await in _call (async)
call @ 759-321cd3240cdbc07b.js:4
await in call (async)
C @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
s @ index-cc4a2d3ea5fbdd8f.js:1
getInitialTasks @ index-cc4a2d3ea5fbdd8f.js:1
run @ index-cc4a2d3ea5fbdd8f.js:1
AC @ index-cc4a2d3ea5fbdd8f.js:1
c @ 14-aa1ae51ea060ee64.js:1
eU @ framework-2bb1844fb22814b3.js:9
eH @ framework-2bb1844fb22814b3.js:9
(anonymous) @ framework-2bb1844fb22814b3.js:9
re @ framework-2bb1844fb22814b3.js:9
rn @ framework-2bb1844fb22814b3.js:9
(anonymous) @ framework-2bb1844fb22814b3.js:9
oP @ framework-2bb1844fb22814b3.js:9
eF @ framework-2bb1844fb22814b3.js:9
ro @ framework-2bb1844fb22814b3.js:9
nU @ framework-2bb1844fb22814b3.js:9
nD @ framework-2bb1844fb22814b3.js:9
759-321cd3240cdbc07b.js:2 LLM c24d15bf-e9b1-40b4-bd1e-cf55ec527ad8 errored: OperationError: The operation failed for an operation-specific reason

759-321cd3240cdbc07b.js:4 Entering new llm_chain chain...
759-321cd3240cdbc07b.js:1 Starting LLM 71b460f3-54a5-4714-a65a-cb88e72e609c with name webLlm with prompts: You have the following objective: `Write me a magic system for dnd 5e based on the 5 colors of magic the gathering`. Create a list of zero to four tasks to be completed by you such that your goal is more closely reached or completely reached. The response list MUST be a SINGLE ARRAY OF STRINGS where each string is a TASK NAME wrapped in quotes (EXAMPLE OF RESPONSE FORMAT: "["task name", "task name"]"). You MUST be able to parse the array of strings with Javascript’s JSON.parse() function. You must respond with the array WITHOUT ANY OTHER TEXT.

agentllm.vercel.app/:1 Uncaught (in promise) DOMException: Device is lost
Promise.then (async)
deviceCopyFromGPU @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ index-cc4a2d3ea5fbdd8f.js:1
g @ index-cc4a2d3ea5fbdd8f.js:1
$func1797 @ 009c33da:0x104fc5
$func1895 @ 009c33da:0x10dc14
$func1633 @ 009c33da:0xfda33
$_ZN3tvm7runtime7NDArray10CopyFromToEPK8DLTensorPS2_Pv @ 009c33da:0xd19fa
$TVMArrayCopyFromTo @ 009c33da:0x10324e
copyFrom @ index-cc4a2d3ea5fbdd8f.js:1
updateLogitsOnCPU @ index-cc4a2d3ea5fbdd8f.js:1
sampleTokenFromLogits @ index-cc4a2d3ea5fbdd8f.js:1
generate @ index-cc4a2d3ea5fbdd8f.js:1
await in generate (async)
e @ index-cc4a2d3ea5fbdd8f.js:1
await in e (async)
_call @ index-cc4a2d3ea5fbdd8f.js:1
_generate @ 759-321cd3240cdbc07b.js:7
_generateUncached @ 759-321cd3240cdbc07b.js:7
await in _generateUncached (async)
generate @ 759-321cd3240cdbc07b.js:7
generatePrompt @ 759-321cd3240cdbc07b.js:7
_call @ 759-321cd3240cdbc07b.js:4
await in _call (async)
call @ 759-321cd3240cdbc07b.js:4
await in call (async)
C @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
u @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
s @ index-cc4a2d3ea5fbdd8f.js:1
getInitialTasks @ index-cc4a2d3ea5fbdd8f.js:1
run @ index-cc4a2d3ea5fbdd8f.js:1
AC @ index-cc4a2d3ea5fbdd8f.js:1
c @ 14-aa1ae51ea060ee64.js:1
eU @ framework-2bb1844fb22814b3.js:9
eH @ framework-2bb1844fb22814b3.js:9
(anonymous) @ framework-2bb1844fb22814b3.js:9
re @ framework-2bb1844fb22814b3.js:9
rn @ framework-2bb1844fb22814b3.js:9
(anonymous) @ framework-2bb1844fb22814b3.js:9
oP @ framework-2bb1844fb22814b3.js:9
eF @ framework-2bb1844fb22814b3.js:9
ro @ framework-2bb1844fb22814b3.js:9
nU @ framework-2bb1844fb22814b3.js:9
nD @ framework-2bb1844fb22814b3.js:9
759-321cd3240cdbc07b.js:2 LLM 71b460f3-54a5-4714-a65a-cb88e72e609c errored: OperationError: The operation failed for an operation-specific reason

759-321cd3240cdbc07b.js:4 Entering new llm_chain chain...
759-321cd3240cdbc07b.js:1 Starting LLM 1a4dc791-4e98-444d-a2e6-1fcf9e6a5c29 with name webLlm with prompts: You have the following objective: `Write me a magic system for dnd 5e based on the 5 colors of magic the gathering`. Create a list of zero to four tasks to be completed by you such that your goal is more closely reached or completely reached. The response list MUST be a SINGLE ARRAY OF STRINGS where each string is a TASK NAME wrapped in quotes (EXAMPLE OF RESPONSE FORMAT: "["task name", "task name"]"). You MUST be able to parse the array of strings with Javascript’s JSON.parse() function. You must respond with the array WITHOUT ANY OTHER TEXT.

agentllm.vercel.app/:1 Uncaught (in promise) DOMException: Device is lost
Promise.then (async)
deviceCopyFromGPU @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ index-cc4a2d3ea5fbdd8f.js:1
g @ index-cc4a2d3ea5fbdd8f.js:1
$func1797 @ 009c33da:0x104fc5
$func1895 @ 009c33da:0x10dc14
$func1633 @ 009c33da:0xfda33
$_ZN3tvm7runtime7NDArray10CopyFromToEPK8DLTensorPS2_Pv @ 009c33da:0xd19fa
$TVMArrayCopyFromTo @ 009c33da:0x10324e
copyFrom @ index-cc4a2d3ea5fbdd8f.js:1
updateLogitsOnCPU @ index-cc4a2d3ea5fbdd8f.js:1
sampleTokenFromLogits @ index-cc4a2d3ea5fbdd8f.js:1
generate @ index-cc4a2d3ea5fbdd8f.js:1
await in generate (async)
e @ index-cc4a2d3ea5fbdd8f.js:1
await in e (async)
_call @ index-cc4a2d3ea5fbdd8f.js:1
_generate @ 759-321cd3240cdbc07b.js:7
_generateUncached @ 759-321cd3240cdbc07b.js:7
await in _generateUncached (async)
generate @ 759-321cd3240cdbc07b.js:7
generatePrompt @ 759-321cd3240cdbc07b.js:7
_call @ 759-321cd3240cdbc07b.js:4
await in _call (async)
call @ 759-321cd3240cdbc07b.js:4
await in call (async)
C @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
u @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
u @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
s @ index-cc4a2d3ea5fbdd8f.js:1
getInitialTasks @ index-cc4a2d3ea5fbdd8f.js:1
run @ index-cc4a2d3ea5fbdd8f.js:1
AC @ index-cc4a2d3ea5fbdd8f.js:1
c @ 14-aa1ae51ea060ee64.js:1
eU @ framework-2bb1844fb22814b3.js:9
eH @ framework-2bb1844fb22814b3.js:9
(anonymous) @ framework-2bb1844fb22814b3.js:9
re @ framework-2bb1844fb22814b3.js:9
rn @ framework-2bb1844fb22814b3.js:9
(anonymous) @ framework-2bb1844fb22814b3.js:9
oP @ framework-2bb1844fb22814b3.js:9
eF @ framework-2bb1844fb22814b3.js:9
ro @ framework-2bb1844fb22814b3.js:9
nU @ framework-2bb1844fb22814b3.js:9
nD @ framework-2bb1844fb22814b3.js:9
759-321cd3240cdbc07b.js:2 LLM 1a4dc791-4e98-444d-a2e6-1fcf9e6a5c29 errored: OperationError: The operation failed for an operation-specific reason

759-321cd3240cdbc07b.js:4 Entering new llm_chain chain...
759-321cd3240cdbc07b.js:1 Starting LLM f7af48a7-32f4-40b3-8b88-5adf17d7bf29 with name webLlm with prompts: You have the following objective: `Write me a magic system for dnd 5e based on the 5 colors of magic the gathering`. Create a list of zero to four tasks to be completed by you such that your goal is more closely reached or completely reached. The response list MUST be a SINGLE ARRAY OF STRINGS where each string is a TASK NAME wrapped in quotes (EXAMPLE OF RESPONSE FORMAT: "["task name", "task name"]"). You MUST be able to parse the array of strings with Javascript’s JSON.parse() function. You must respond with the array WITHOUT ANY OTHER TEXT.

agentllm.vercel.app/:1 Uncaught (in promise) DOMException: Device is lost
Promise.then (async)
deviceCopyFromGPU @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ index-cc4a2d3ea5fbdd8f.js:1
g @ index-cc4a2d3ea5fbdd8f.js:1
$func1797 @ 009c33da:0x104fc5
$func1895 @ 009c33da:0x10dc14
$func1633 @ 009c33da:0xfda33
$_ZN3tvm7runtime7NDArray10CopyFromToEPK8DLTensorPS2_Pv @ 009c33da:0xd19fa
$TVMArrayCopyFromTo @ 009c33da:0x10324e
copyFrom @ index-cc4a2d3ea5fbdd8f.js:1
updateLogitsOnCPU @ index-cc4a2d3ea5fbdd8f.js:1
sampleTokenFromLogits @ index-cc4a2d3ea5fbdd8f.js:1
generate @ index-cc4a2d3ea5fbdd8f.js:1
await in generate (async)
e @ index-cc4a2d3ea5fbdd8f.js:1
await in e (async)
_call @ index-cc4a2d3ea5fbdd8f.js:1
_generate @ 759-321cd3240cdbc07b.js:7
_generateUncached @ 759-321cd3240cdbc07b.js:7
await in _generateUncached (async)
generate @ 759-321cd3240cdbc07b.js:7
generatePrompt @ 759-321cd3240cdbc07b.js:7
_call @ 759-321cd3240cdbc07b.js:4
await in _call (async)
call @ 759-321cd3240cdbc07b.js:4
await in call (async)
C @ index-cc4a2d3ea5fbdd8f.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
u @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
u @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
u @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
Promise.then (async)
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
l @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
(anonymous) @ 759-321cd3240cdbc07b.js:1
a @ 759-321cd3240cdbc07b.js:1
s @ 759-321cd3240cdbc07b.js:1
s @ index-cc4a2d3ea5fbdd8f.js:1
getInitialTasks @ index-cc4a2d3ea5fbdd8f.js:1
run @ index-cc4a2d3ea5fbdd8f.js:1
AC @ index-cc4a2d3ea5fbdd8f.js:1
c @ 14-aa1ae51ea060ee64.js:1
eU @ framework-2bb1844fb22814b3.js:9
eH @ framework-2bb1844fb22814b3.js:9
(anonymous) @ framework-2bb1844fb22814b3.js:9
re @ framework-2bb1844fb22814b3.js:9
rn @ framework-2bb1844fb22814b3.js:9
(anonymous) @ framework-2bb1844fb22814b3.js:9
oP @ framework-2bb1844fb22814b3.js:9
eF @ framework-2bb1844fb22814b3.js:9
ro @ framework-2bb1844fb22814b3.js:9
nU @ framework-2bb1844fb22814b3.js:9
nD @ framework-2bb1844fb22814b3.js:9
759-321cd3240cdbc07b.js:2 LLM f7af48a7-32f4-40b3-8b88-5adf17d7bf29 errored: OperationError: The operation failed for an operation-specific reason

index-cc4a2d3ea5fbdd8f.js:1 DOMException: The operation failed for an operation-specific reason
undefined
agentllm.vercel.app/:1 Uncaught (in promise) DOMException: Device is lost