Chat & Embeddings User testing feedback - Githubissues

sourcegraph / cody

Type less, code more: Cody is an AI code assistant that uses advanced search and codebase context to help you write and fix code.

https://cody.dev

Apache License 2.0

2.73k stars 298 forks source link

Chat & Embeddings User testing feedback #2319

Closed dominiccooney closed 8 months ago

dominiccooney commented 11 months ago

This is a summary of user testing in https://app.usertesting.com/workspaces/937482/study/4934180

Observations:

Tab management painful/inline chat would be better (x2)
Users aren't sure what enhanced context does/enabling embeddings does (x2)
Embeddings indexing takes time (x1)
Embeddings indexing is a privacy issue (x1)
Ignored the blue dot and used @-context (x1)
VSCode marketplace advertises really old version of the extension. Gets a prompt to install Cody App, etc. (x1) (link)

Bugs:

2318

Low hanging fruit:

[ ] Make the extension phone home to find the current version and display a banner when it is really out of date.
[ ] Clarify retention policy to assuage privacy concerns.
[ ] Add the docs links back to the explain context selector.
[ ] Support querying in-progress embeddings indexes. Maybe toast something positive about the context intensifying for slow indexes.

github-actions[bot] commented 9 months ago

This issue is marked as stale because it has been open 60 days with no activity. Remove stale label or comment or this will be closed automatically in 5 days.