logancyang
commented
1 week ago - This is not an issue and should be in discussion.
- Ollama has long been a provider, it's not added in 2.7.0.
- Model selection and combination can vary quite a lot. The quality depends heavily on the chat model, the embedding model's impact is not as significant as the chat model.
Background
Since the release of 2.7.0, this plugin supports Ollama as one of the local index providers. However, it is not sure that when it comes to
Vault QA, which model has the best behavior that satisfies your need.Core Issue
To compare the pros and cons of different AI models that best suit the daily assistance in Obsidian.
Analysis
Personally, I would like to give few questions to the AI models to test their feedbacks, but I am not sure if the result will be different in other vaults. Below are few examples of my questions based on gpt4o-mini:
Example Q&As
Task Management
Question: What are the incompleted todos in my vault? Please classify them with following rules: If there's nothing inside the [], the task is incompleted; If there's a "-" symbol inside the [], the task is canceled; If there's a "<" symbol inside the [], the task is postponed;
Answer: Based on your request and the classification rules provided, here is the comprehensive list of uncompleted tasks in your vault, categorized accordingly:
Incompleted Tasks: []
These tasks are marked as uncompleted and do not have any cancellation or postponement indicators:
Canceled Tasks: [-]
These tasks are marked as canceled and contain a "-" in their brackets:
Postponed Tasks: [<]
These tasks are marked as postponed and contain a "<" in their brackets:
Summary
This classification should help you manage your tasks more effectively by clearly distinguishing between what is still pending, what has been canceled, and what has been postponed. If you need further assistance or additional classifications, feel free to ask!
Sources:
Review: ⭐⭐⭐⭐ The tasks are 100% listed but the classification is mixed. Only the following tasks are incompleted:
The other tasks are either canceled or rescheduled, but the ai agent did not recognize, for example:
Progress Tracking
Question: Please check the note [[cpp overview]], there are completed todos and uncompleted todos. Based on the completion date of my completed todos in cpp overview only, can you estimate when will I finish all the uncompleted todos in cpp overview?
Answer: To estimate the completion date for the uncompleted tasks in the note [[Cpp Overview]], we can analyze the completed tasks and their completion dates.
Completed Tasks
All completed tasks in the note were marked as completed on September 25, 2024. This includes tasks from Chapter 0 and Chapter 1, which cover foundational concepts in C++.
Uncompleted Tasks
The uncompleted tasks span multiple chapters, including Chapters 2 through 28, with a total of over 100 tasks remaining.
Estimation Approach
Estimation Calculation
Assuming a steady pace of completing tasks, if you were to complete, for example, 5 tasks per week, it would take around 20 weeks to finish all remaining tasks.
Estimated Completion Date
Calculating 20 weeks from September 25, 2024, leads us to approximately January 15, 2025.
Conclusion
If you maintain a steady pace of completing about 5 tasks per week, you can expect to finish all uncompleted tasks in the note [[Cpp Overview]] by January 15, 2025. Adjustments can be made based on your actual pace of work or any changes in your schedule.
Sources:
Review: ⭐⭐⭐⭐ The reply does understand what I mean, but the result is inaccurate. My latest completion date on the todos is 2024-10-17, and I have chapter 2 half completed. However, the reply only covers chapter 0 and chapter 1 that is 100% completed, which is not accurate and understandable enough.
Deleted:
Content Linking
Question: Can you summarize the key points mentioned in all my notes regarding P.A.R.A. and suggest any related topics I should explore?
Answer: Based on your notes regarding the P.A.R.A. (Projects, Areas, Resources, Archive) organizational method, here are the key points summarized:
Key Points of P.A.R.A.
Projects:
Areas:
Resources:
Archive:
Related Topics to Explore
Task Management Techniques:
Knowledge Management Systems:
Digital Organization Tools:
Productivity Strategies:
Mind Mapping:
Continuous Learning:
Review and Reflection Practices:
By delving into these related topics, you can enhance your understanding and application of the P.A.R.A. method, ultimately improving your organization and productivity in both personal and professional contexts.
Sources:
Review: ⭐⭐⭐⭐⭐ The summarization is cool. It indeed give a reference of all the notes that has backlinks or links to the main note regarding P.A.R.A.
Log Tracing
Q: Please review the "Daily Notes" folder, and check when did I play Black Myth Wukong.
A: In August 2024, you played "黑神话悟空" (Black Myth Wukong) on the following dates:
August 14, 2024
You recorded testing "黑神话悟空" with two attached images.
August 21, 2024
You noted down items related to "黑神话悟空", including references to various locations and tasks within the game.
August 25, 2024
You mentioned testing "泡酒物" (a type of item) in relation to "黑神话悟空."
These entries indicate your engagement with the game on these specific dates in August.
Sources: 2024-08-21 2024-08-14 2024-08-20 2024-08-22 2024-09-14 2024-08-23 Monthly Notes 2024 - 09 2024 - 08 2024-08-25
Review: ⭐⭐⭐⭐⭐ It actually helps to find the accurate dates that I recorded my experience in daily notes for the video game, so I would give it ⭐⭐⭐⭐⭐.
Summary
Based on the personal rating on following questions:
The model gpt4o-mini is powerful but not good at tasks analyzing. The respnding speed is also limited when it comes to complex questions.