GoogleCloudPlatform / generative-ai

Sample code and notebooks for Generative AI on Google Cloud, with Gemini on Vertex AI
https://cloud.google.com/vertex-ai/docs/generative-ai/learn/overview
Apache License 2.0
8.29k stars 2.33k forks source link

Vertex AI Conversation app not giving useful answers #263

Closed koverholt closed 1 year ago

koverholt commented 1 year ago

The agent behind the demo app at https://vertex-ai-conversation.web.app/ is not giving useful answers:

Screenshot 2023-11-13 at 11 09 00 AM

koverholt commented 1 year ago

The agent in Dialogflow CX is still wired up to a website data store, and utterances are triggering results from Vertex AI Search, for example from the full debug response:

        {
          "info": "projects/964731510884/locations/global/collections/default_collection/dataStores/google-store-demo-app_1691005340663",
          "status": {
            "code": "OK"
          },
          "responses": [
            {
              "url": "https://store.google.com/us/config/pixel_6a?hl=en-US",
              "text": "Ucs content search result with 1 answers, 0 passages, 7 segments",
              "debugId": "86cb50e7-a16d-43d4-9562-7e3fc37e25f1",
              "document": "projects/964731510884/locations/global/collections/default_collection/dataStores/google-store-demo-app_1691005340663/branches/0/documents/6841ea42b1994dbc5081ba48c2f69e4d"
            },
            {
              "url": "https://store.google.com/us/product/pixelbook_go",
              "document": "projects/964731510884/locations/global/collections/default_collection/dataStores/google-store-demo-app_1691005340663/branches/0/documents/4d04dc518ff40f6a955bfc4a745a0ac4",
              "text": "Ucs content search result with 1 answers, 0 passages, 5 segments",
              "debugId": "c5b426f8-580e-4a69-9d51-ce776110a5d9"
            },
            {
              "document": "projects/964731510884/locations/global/collections/default_collection/dataStores/google-store-demo-app_1691005340663/branches/0/documents/ba805a92771b34211cae0a59ecedf24a",
              "debugId": "7a2a35ad-a9ec-4717-bb6b-e1811cedb4ba",
              "url": "https://store.google.com/us/product/otterbox_defender_pixel_6_pro",
              "text": "Ucs content search result with 1 answers, 0 passages, 3 segments"
            },

So I'm looking to see if there are any known issues with Vertex AI Conversation or if this issue is specific to this agent.

koverholt commented 1 year ago

I'm not sure what happened to the original agent and why it's not returning data store answers. I had an identically configured agent that I was able to switch to in #264, so I did that so that the sample app works for now, and I'll continue to look into why the original agent stopped working.