search

kylestratis / llm-knowledge-agent

MIT License
2 stars 0 forks source link

Zettel generator #9

Closed kylestratis closed 1 year ago

kylestratis commented 1 year ago

Build the tool to create Zettels. The implementation of this might be the second trickiest - do we just use the main points found? This should also include some generic metadata. These won't be immediately written out, as similarity search against the rest of the knowledgebase will still need to be done.

Optional: user-led refinement

kylestratis commented 1 year ago

Take main ideas and article as context (embedding?) and then use generator to expand on each point given the context of the article and/or similar zettels in knowledgebase.

kylestratis commented 1 year ago

We can't use an embedding as context, nor the full article text as the generate endpoint is limited to 2048 tokens. So instead I'm going with a prompt like this:

Assertion: "{main_idea}"

Based on the assertion above, write a reference note using additional outside information.

kylestratis commented 1 year ago

I decided to use the outline as additional context. I'll have to catch an error if the prompt is too long. See here