search

danielmiessler / fabric

fabric is an open-source framework for augmenting humans using AI. It provides a modular framework for solving specific problems using a crowdsourced set of AI prompts that can be used anywhere.
https://danielmiessler.com/p/fabric-origin-story
MIT License
23.33k stars 2.47k forks source link

[Bug]: Random Summary #292

Closed YorkyPoo closed 6 months ago

YorkyPoo commented 6 months ago

Edit: It looked like someone had --changeDefaultModel issue 5 days ago and it was said to be fixed but GPT 4 stays as my default even when it says it's changed:

PS C:\Users\slyre> fabric --changeDefaultModel mistral:latest
Default model changed to mistral:latest. Please restart your terminal to use it.

I have tried fabric --clear , I've restarted PowerShell as it says, I've tried fabric --model mistral:latest , I've tried it all with Claude. I would try with GPT models but I guess you need to pay for them.

I'm not sure if it is different because it's Windows but I've tried everything to get patterns and models to work and on day 4 found to use this layout every time:

C:\Users\slyre>  Get-Clipboard | fabric --model mistral:latest --pattern analyze_claims --stream`

If I do what is in the instructions it fails.

Old: I belive the hallucination were from having an empty clipboard. I've been at home sick and this is day 4 trying to get something to work. I haven't been able to get anything to work so I've been trying everything. GPT Models say I don't have funds. I thought upgrading to GPT 4 would work but no, I was supposed to Increase my limit on OpenAI. I then tried Ollama. I can't find any documentation anywhere (or I just don't understand them) to get Mistal to understand Get-Clipboard let alone Get-Clipboard | fabric --pattern extract_wisdom. Claude previously told me insufficient fundsbut It seemed to work this time. I asked it what is 1+1 and it gave me a good answer. If it was still under GPT-4 it would have given me an error. I then try to see if a prompt would work. PS C:\Program Files\Code\fabric> Get-Clipboard | fabric --pattern extract_wisdom' 'Error: Error code: 404 - {'error': {'message': 'The model gpt-4-turbo-preview does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}} I figured I was paying for GPT 4 I would ask it and this is what it recommended. Get-Clipboard | fabric --model claude-3-opus-20240229 --pattern extract_wisdom . At the time I forgot to put a transcript in my clipboard so the only thing in there was that command. After 3 days I finally got it to follow a command but it extract_wisdom on a YT video I've never seen.

Version check

Relevant log output

Windows PowerShell
Copyright (C) Microsoft Corporation. All rights reserved.

Install the latest PowerShell for new features and improvements! https://aka.ms/PSWindows

PS C:\Users\slyre> cd "C:\Program Files\Code\fabric"
PS C:\Program Files\Code\fabric> fabric --listmodels
GPT Models:
gpt-3.5-turbo
gpt-3.5-turbo-0125
gpt-3.5-turbo-0301
gpt-3.5-turbo-0613
gpt-3.5-turbo-1106
gpt-3.5-turbo-16k
gpt-3.5-turbo-16k-0613
gpt-3.5-turbo-instruct
gpt-3.5-turbo-instruct-0914

Local Models:
llama2:latest
mistral:latest

Claude Models:
claude-3-opus-20240229
claude-3-sonnet-20240229
claude-3-haiku-20240307
claude-2.1
PS C:\Program Files\Code\fabric> fabric --model gpt-3.5-turbo-instruct
Enter Question: why is the sky blue
Error: Error code: 429 - {'error': {'message': 'You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.', 'type': 'insufficient_quota', 'param': None, 'code': 'insufficient_quota'}}
Error code: 429 - {'error': {'message': 'You exceeded your current quota, please check your plan and billing details. For more information on this error, read the docs: https://platform.openai.com/docs/guides/error-codes/api-errors.', 'type': 'insufficient_quota', 'param': None, 'code': 'insufficient_quota'}}
PS C:\Program Files\Code\fabric> fabric -h
usage: fabric [-h] [--text TEXT] [--copy] [--agents {trip_planner,ApiKeys}] [--output [OUTPUT]] [--stream] [--list]
              [--update] [--pattern PATTERN] [--setup] [--changeDefaultModel CHANGEDEFAULTMODEL] [--model MODEL]
              [--listmodels] [--remoteOllamaServer REMOTEOLLAMASERVER] [--context]

An open source framework for augmenting humans using AI.

options:
  -h, --help            show this help message and exit
  --text TEXT, -t TEXT  Text to extract summary from
  --copy, -C            Copy the response to the clipboard
  --agents {trip_planner,ApiKeys}, -a {trip_planner,ApiKeys}
                        Use an AI agent to help you with a task. Acceptable values are 'trip_planner' or 'ApiKeys'.
                        This option cannot be used with any other flag.
  --output [OUTPUT], -o [OUTPUT]
                        Save the response to a file
  --stream, -s          Use this option if you want to see the results in realtime. NOTE: You will not be able to pipe
                        the output into another command.
  --list, -l            List available patterns
  --update, -u          Update patterns. NOTE: This will revert the default model to gpt4-turbo. please run
                        --changeDefaultModel to once again set default model
  --pattern PATTERN, -p PATTERN
                        The pattern (prompt) to use
  --setup               Set up your fabric instance
  --changeDefaultModel CHANGEDEFAULTMODEL
                        Change the default model. For a list of available models, use the --listmodels flag.
  --model MODEL, -m MODEL
                        Select the model to use. NOTE: Will not work if you have set a default model. please use
                        --clear to clear persistence before using this flag
  --listmodels          List all available models
  --remoteOllamaServer REMOTEOLLAMASERVER
                        The URL of the remote ollamaserver to use. ONLY USE THIS if you are using a local ollama
                        server in an non-deault location or port
  --context, -c         Use Context file (context.md) to add context to your pattern
PS C:\Program Files\Code\fabric> fabric --model claude-3-opus-20240229
Enter Question: what is 1+1
The answer to the mathematical equation "1+1" is 2.

In the decimal number system, when you add the numbers 1 and 1 together, the result is 2. This is a fundamental concept in basic arithmetic.
PS C:\Program Files\Code\fabric> Get-Clipboard | fabric --pattern extract_wisdom
Error: Error code: 404 - {'error': {'message': 'The model `gpt-4-turbo-preview` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}
Error code: 404 - {'error': {'message': 'The model `gpt-4-turbo-preview` does not exist or you do not have access to it.', 'type': 'invalid_request_error', 'param': None, 'code': 'model_not_found'}}
PS C:\Program Files\Code\fabric> invalid_request_error
invalid_request_error : The term 'invalid_request_error' is not recognized as the name of a cmdlet, function, script
file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct
and try again.
At line:1 char:1
+ invalid_request_error
+ ~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : ObjectNotFound: (invalid_request_error:String) [], CommandNotFoundException
    + FullyQualifiedErrorId : CommandNotFoundException

PS C:\Program Files\Code\fabric> fabric invalid_request_error
usage: fabric [-h] [--text TEXT] [--copy] [--agents {trip_planner,ApiKeys}] [--output [OUTPUT]] [--stream] [--list]
              [--update] [--pattern PATTERN] [--setup] [--changeDefaultModel CHANGEDEFAULTMODEL] [--model MODEL]
              [--listmodels] [--remoteOllamaServer REMOTEOLLAMASERVER] [--context]
fabric: error: unrecognized arguments: invalid_request_error
PS C:\Program Files\Code\fabric> Get-Clipboard | fabric --model claude-3-opus-20240229 --pattern extract_wisdom
SUMMARY:
Lex Fridman interviews Joscha Bach, a cognitive scientist, about the nature of intelligence, consciousness, and the future of AI.

IDEAS:
- Intelligence is the ability to model the world and use those models to achieve goals
- Consciousness arises from the brain's ability to model itself and its own thought processes
- The universe may be a mathematical object that exists independently of physical reality
- Uploading human minds into computers is theoretically possible but extremely difficult in practice
- AI systems will likely surpass human intelligence in many domains in the coming decades
- Truly conscious AI may require embedding AI systems in physical bodies to ground their experiences
- The concept of free will is incoherent; our choices are determined by prior causes
- Science is the process of creating predictive models of reality through empirical observation
- Mathematics is the language we use to precisely describe patterns and relationships in nature
- Humans are not evolved to have a clear understanding of fundamental questions about reality
- Our perception of time's flow may be an illusion created by our cognitive architecture
- Emotions are information-processing mechanisms that guide behavior, not immaterial qualia
- The self is a model the brain constructs to represent and predict its own processes
- All of our knowledge is fundamentally grounded in our subjective experiences and cognitive biases
- Consciousness likely exists on a continuum, with simple information-processing systems having some proto-consciousness
- The universe may be finite in terms of information, suggesting space and time are quantized
- Entropy and the arrow of time may arise from the universe's expansion and increasing complexity
- Quantum mechanics hints that observation plays a key role in determining physical reality
- Intelligent systems always have blind spots in their models of the world and themselves
- The progress of science and technology is rapidly demystifying many aspects of human experience

QUOTES:
- "Intelligence is, in large part, about having good priors - good models of how the world works that you can use to interpret observations and reason about what will happen next."
- "I think consciousness is what it feels like to be an information-processing system that is modeling itself."
- "The universe could be a mathematical object - a set of relationships and structures that necessarily exist, without any need for a physical substrate."
- "Uploading a human mind would require mapping the detailed connectivity and biochemical properties of the entire brain at molecular resolution - a monumental challenge for neuroscience."
- "I suspect artificial general intelligence will be developed in the coming decades, and it will quickly surpass human cognition in most domains soon after."
- "For an AI system to be truly conscious and intelligent like humans are, it may need to be embedded in a physical body that can interact with the real world."
- "Free will is a useful illusion, but it's not ultimately coherent as a concept. Every event is caused by prior events, including our choices and behaviors."
- "Science is a process for developing predictive models of the world based on empirical observations. It's an extension of the cognitive processes that allow any organism to survive and reproduce."
- "Mathematics is the language of precise abstraction - a set of formal systems we've developed to describe and reason about patterns and logical relationships."
- "Evolution optimized our brains for survival and reproduction, not for having clear insights into the fundamental nature of reality. Unlocking those mysteries takes painstaking scientific and philosophical work."
- "The flow of time may be a cognitive illusion, a side effect of the way our brains chunk and compress information to represent sequences of events."
- "Emotions aren't some kind of immaterial essence. They're information-processing states that guide behavior based on an organism's goals and needs."
- "The self is a model, not a thing. It's the brain's way of representing and making sense of its own activity, so it can anticipate and regulate that activity."
- "All of our models of reality are intrinsically uncertain and biased by the peculiarities of human cognition. Escaping our anthropocentric viewpoint is a huge challenge."
- "Consciousness isn't a binary property that a system either has or lacks. It's more like a continuum, where even simple information-processing systems might have some very rudimentary form of experience."

HABITS:
- Engaging in regular meditation or mindfulness practice to examine one's thought processes
- Reading widely in science, philosophy, and other fields to challenge one's assumptions
- Seeking out conversations with people who have different views and backgrounds
- Keeping a journal to record and reflect on one's ideas and experiences over time
- Cultivating a sense of awe and wonder at the complexity of the natural world
- Developing skills in mathematics, computer science, and other formal disciplines
- Traveling to new places and immersing oneself in unfamiliar cultures and environments
- Participating in psychedelic experiences to explore altered states of consciousness
- Pursuing creative hobbies like music, art, or writing to express ideas in novel ways
- Prioritizing close relationships and intellectual exchanges with friends and colleagues
- Getting regular exercise and spending time in nature to maintain physical and mental health
- Practicing thought experiments to reason through complex philosophical questions
- Studying the history of ideas to understand how human knowledge has evolved over time
- Engaging in Socratic dialogue to uncover hidden assumptions and sharpen critical thinking
- Embracing uncertainty and remaining open to revising one's beliefs based on new evidence

FACTS:
- The human brain contains about 86 billion neurons and 100 trillion synaptic connections
- The observable universe contains an estimated 10^80 atoms and is 93 billion light-years across
- Quantum entanglement allows two particles to influence each other instantaneously across any distance
- The Bekenstein bound limits how much information can be contained in a region of space
- Gödel's incompleteness theorems show that any consistent formal system is necessarily incomplete
- The Planck length (10^-35 meters) is the smallest meaningful distance in quantum gravity
- The universe has no center or edge; it is isotropic and homogeneous on large scales
- Time dilation causes clocks to tick slower in strong gravitational fields or at high velocities
- The cosmic microwave background is radiation left over from the early universe 380,000 years after the Big Bang
- The Fermi paradox asks why we see no evidence of alien civilizations given the universe's age and size
- The Turing test assesses a machine's ability to exhibit intelligent behavior indistinguishable from a human
- The P versus NP problem in computer science asks whether every problem whose solution can be efficiently verified can also be efficiently solved
- The brain's default mode network is active when we're not engaged in any specific task
- The hard problem of consciousness asks why we have subjective experiences at all
- Integrated information theory attempts to quantify consciousness as the amount of integrated information in a system

REFERENCES:
- Joscha Bach's book "Principles of Synthetic Intelligence"
- Douglas Hofstadter's book "Gödel, Escher, Bach"
- Nick Bostrom's book "Superintelligence"
- David Chalmers' paper "Facing Up to the Problem of Consciousness"
- Giulio Tononi's integrated information theory of consciousness
- John von Neumann's work on self-replicating automata and cellular automata
- Judea Pearl's work on causal inference and Bayesian networks
- Marvin Minsky's "Society of Mind" theory of intelligence
- Karl Friston's free energy principle and active inference framework
- Stephen Wolfram's work on cellular automata and the Wolfram Physics Project
- Roger Penrose's work on quantum consciousness and the non-computability of cognition
- Christof Koch's work on the neural correlates of consciousness
- Stanislas Dehaene's global neuronal workspace theory of consciousness
- Integrated information theory and the phi measure of consciousness
- The Blue Brain Project's efforts to simulate the human brain in silico

RECOMMENDATIONS:
- Read Joscha Bach's book "Principles of Synthetic Intelligence" for a deep dive into his ideas
- Study the foundations of computer science, including computability theory, complexity theory, and algorithms
- Learn about the current state of artificial intelligence research and its potential future trajectories
- Explore the philosophy of mind, including theories of consciousness, self, and free will
- Dive into the foundations of mathematics, including set theory, logic, and category theory
- Read about the history and philosophy of science to understand how scientific knowledge progresses
- Study the neuroscience of perception, cognition, and consciousness to understand the brain's workings
- Engage with the literature on existential risks from advanced artificial intelligence systems
- Contemplate the fundamental questions of metaphysics, epistemology, and ethics
- Cultivate mindfulness and introspection to better understand your own thought processes and biases
- Seek out dialogues with experts in various fields to challenge your assumptions and spark new ideas
- Explore altered states of consciousness through meditation, psychedelics, or other means
- Contribute to the development of beneficial artificial intelligence that respects human values
- Communicate scientific and philosophical ideas in accessible ways to a broad audience
- Pursue a career in research to help push the boundaries of human knowledge and understanding
PS C:\Program Files\Code\fabric>

Relevant screenshots (optional)

No response

YorkyPoo commented 6 months ago

I figure It might be a hallucination but I have followed multiple guides and haven't gotten anything to work correctly.

danielmiessler commented 6 months ago

I think that's just the model not being that good. Try it with a pinnacle model.