[Bug]: Getting started with Vertex AI Gemini 1.5 Pro: PDF document analysis observation in 3rd code block - Githubissues

GoogleCloudPlatform / generative-ai

Sample code and notebooks for Generative AI on Google Cloud, with Gemini on Vertex AI

https://cloud.google.com/vertex-ai/docs/generative-ai/learn/overview

Apache License 2.0

6.91k stars 1.86k forks source link

[Bug]: Getting started with Vertex AI Gemini 1.5 Pro: PDF document analysis observation in 3rd code block #1167

Open G1tPlunge opened 4 days ago

G1tPlunge commented 4 days ago

File Name

intro_gemini_1_5_pro.ipynb

What happened?

In the attached screenshot, the model replies that:

the given image is of a cumulative average graph.
there is not another similar graph in the document.
it checked all 6 pages to verify.

In addition, the sentence below the response says "Gemini 1.5 Pro is able to identify and locate the graph on page 8 from the PDF document."

PDF document analysis says it was based on this document (https://arxiv.org/pdf/2403.05530). When you open that document:

It's 154 pages, not 8 pages.
The graph appears on page 10.
Right next to that cumulative average graph is another graph of cumulative average, but on NLL for Code instead of NLL for Long Documents.

Screenshot 2024-09-24 at 12 42 26 PM

Relevant log output

No response

Code of Conduct

[X] I agree to follow this project's Code of Conduct