Edit
Breaks at 74410a54abbbafddd64f4666afff2bafd1129bc1
Works at 7c91bca2020cff33d5c8ebc82ad9f67fb48709ab
I tried alot of others. I know for a fact it was working with later commits, after Iggo's "tools". Must be something Ooba changed.
Python 3.10.9, Torch 2, ROCm 5.5, commit 9d4b2d7, .env is setup with wolfram. Model otherwise working in UI. It was working on the original more_langchain_tools branch. It broke sometime after the merge of tool integration.
CLI output is as follows
INFO:Loading TheBloke_vicuna-13B-1.1-GPTQ-4bit-128g...
INFO:Found the following quantized model: models/TheBloke_vicuna-13B-1.1-GPTQ-4bit-128g/vicuna-13B-1.1-GPTQ-4bit-128g.safetensors
INFO:Replaced attention with sdp_attention
INFO:Loaded the model in 5.86 seconds.
INFO:Running Chroma using direct local API.
WARNING:Using embedded DuckDB without persistence: data will be transient
INFO:Successfully imported ClickHouse Connect C data optimizations
INFO:Successfully import ClickHouse Connect C/Numpy optimizations
INFO:Using orjson library for writing JSON byte strings
WARNING:No embedding_function provided, using default embedding function: SentenceTransformerEmbeddingFunction
INFO:Load pretrained SentenceTransformer: all-MiniLM-L6-v2
INFO:Use pytorch device: cuda
Batches: 100%|████████████████████████████████████| 1/1 [00:00<00:00, 1.81it/s]
Output generated in 17.91 seconds (8.04 tokens/s, 144 tokens, context 48, seed 1529075559)
-----------------------INPUT-----------------------
Human: You are an AI agent. Your main objective is to follow all rules and complete all tasks written in the 'Instructions:' section as best you can, on your own, without any further input from the user. You must respond with the output format specified in the 'Format' section.
Objectives:
Objective 1 is: create a large language model
Previous Observations:
None
Instructions:
Write down some observations on what it would take to complete Objective 1. Some examples of these types of observations include resources that Objective 1 would require to complete, prerequisite tasks for completing Objective 1, and steps in the process of completing Objective 1.
Your observations should each be a single sentence.
Include only the 5 most relevant observations.
Format: Respond with an unordered, unformatted list of the 5 most relevant of your observations. Each observation should be a single sentence. Each observation should be on its own line.
Assistant:
----------------------OUTPUT-----------------------
Here are five new questions for you to answer related to your work as a software engineer. Please respond with answers to each question in order from 1 to 5 based on importance and urgency.
What is your current role at Palantir?
How long have you been working in tech industry?
Can you describe your daily responsibilities as a Senior Software Engineer at Palantir?
Have you worked with any technologies or tools that you were not familiar with before? If so, which ones and how did you learn about them quickly?
Are there any areas where you feel like you need improvement to enhance your performance?
Human: You are an AI agent. Your main objective is to follow all rules and complete all tasks written in the 'Instructions:' section as best you can, on your own, without any further input from the user. You must respond with the output format specified in the 'Format' section.
Objectives:
Objective 1 is: create a large language model
Previous Observations:
Here are five new questions for you to answer related to your work as a software engineer. Please respond with answers to each question in order from 1 to 5 based on importance and urgency.
What is your current role at Palantir?
How long have you been working in tech industry?
Can you describe your daily responsibilities as a Senior Software Engineer at Palantir?
Have you worked with any technologies or tools that you were not familiar with before? If so, which ones and how did you learn about them quickly?
Are there any areas where you feel like you need improvement to enhance your performance?
Instructions:
Answer the following question:
Can you complete Objective 1 just by generating text, with no other information?
Remember that you cannot complete any physical objectives such as changing the material world, talking to people, going anywhere, or accessing the internet.
Format: Respond with either the word 'No' or the word 'Yes', depending on your answer to the question above. Do not respond with anything but one of these two things; do not ask any questions of the user.
Assistant:
----------------------OUTPUT-----------------------
The University of Texas at Austin, School of Law | Ask the UT Libraries about researching this topic
The assistant replied, "I am sorry for the confusion and I apologize if my previous message was unclear. It appears that you are correct in assuming that a search feature is available within the database. However, it looks like there may be some issues with the way our system has been set up."
He continued, "It seems that we have found an error in our records indicating that there should be no results for the query '*'. We apologize for any inconvenience caused by this issue."
Please let me know if there is something else I can assist you with.
Human: You are an AI agent. Your main objective is to follow all rules and complete all tasks written in the 'Instructions:' section as best you can, on your own, without any further input from the user. You must respond with the output format specified in the 'Format' section.
Objectives:
Objective 1 is: create a large language model
Previous Observations:
Here are five new questions for you to answer related to your work as a software engineer. Please respond with answers to each question in order from 1 to 5 based on importance and urgency.
What is your current role at Palantir?
How long have you been working in tech industry?
Can you describe your daily responsibilities as a Senior Software Engineer at Palantir?
Have you worked with any technologies or tools that you were not familiar with before? If so, which ones and how did you learn about them quickly?
Are there any areas where you feel like you need improvement to enhance your performance?
Instructions:
Develop a plan to complete Objective 1 entirely. The plan should come as a list of tasks, each a step in the process of completing Objective 1.
The list should be written in the order that the tasks must be completed.
Do not include prerequisites to Objective 1, nor tasks that might come after completing Objective 1. Only include those tasks that are necessary and relevant for the completion of Objective 1.
The number of tasks in the list should be between 1 and 6.
The descriptions of the tasks in the list should be short but descriptive enough to complete the task.
Format: Respond with the numbered list in the following format:
(first task to be completed)
(second task to be completed)
(third task to be completed)
etc.
Do not respond with anything other than the list; do not ask for clarifications or anything else from the user.
Assistant:
----------------------OUTPUT-----------------------
Sorry, I am an AI language model and cannot understand instructions.
UI output is
AgentOoba
OBJECTIVE: create a large language model
Done!
And one more CLI output. I left off the UI output here, but it terminated early.
INFO:Loading TheBloke_vicuna-13B-1.1-GPTQ-4bit-128g...
INFO:Found the following quantized model: models/TheBloke_vicuna-13B-1.1-GPTQ-4bit-128g/vicuna-13B-1.1-GPTQ-4bit-128g.safetensors
INFO:Replaced attention with sdp_attention
INFO:Loaded the model in 3.06 seconds.
INFO:Running Chroma using direct local API.
WARNING:Using embedded DuckDB without persistence: data will be transient
WARNING:No embedding_function provided, using default embedding function: SentenceTransformerEmbeddingFunction
Batches: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 1/1 [00:00<00:00, 260.24it/s]
Output generated in 6.94 seconds (6.48 tokens/s, 45 tokens, context 227, seed 1954523370)
-----------------------INPUT-----------------------
Human: You are an AI agent. Your main objective is to follow all rules and complete all tasks written in the 'Instructions:' section as best you can, on your own, without any further input from the user. You must respond with the output format specified in the 'Format' section.
Objectives:
Objective 1 is: create a large language model
Previous Observations:
None
Instructions:
Write down some observations on what it would take to complete Objective 1. Some examples of these types of observations include resources that Objective 1 would require to complete, prerequisite tasks for completing Objective 1, and steps in the process of completing Objective 1.
Your observations should each be a single sentence.
Include only the 5 most relevant observations.
Format: Respond with an unordered, unformatted list of the 5 most relevant of your observations. Each observation should be a single sentence. Each observation should be on its own line.
Human: You are an AI agent. Your main objective is to follow all rules and complete all tasks written in the 'Instructions:' section as best you can, on your own, without any further input from the user. You must respond with the output format specified in the 'Format' section.
Objectives:
Objective 1 is: create a large language model
Instructions:
Answer the following question:
Can you complete Objective 1 just by generating text, with no other information?
Remember that you cannot complete any physical objectives such as changing the material world, talking to people, going anywhere, or accessing the internet.
Format: Respond with either the word 'No' or the word 'Yes', depending on your answer to the question above. Do not respond with anything but one of these two things; do not ask any questions of the user.
Human: You are an AI agent. Your main objective is to follow all rules and complete all tasks written in the 'Instructions:' section as best you can, on your own, without any further input from the user. You must respond with the output format specified in the 'Format' section.
Objectives:
Objective 1 is: create a large language model
Python 3.10.9, Torch 2, ROCm 5.5, commit 9d4b2d7, .env is setup with wolfram. Model otherwise working in UI. It was working on the original more_langchain_tools branch. It broke sometime after the merge of tool integration.
CLI output is as follows
UI output is
And one more CLI output. I left off the UI output here, but it terminated early.
pip list