vision2

[pseudotensor]

• [x] Make it easy to ingest the generated image (instead of saving and uploading). Drag-n-drop seems to work, but we removed.
• [ ] Image change in front of UI
• [x] LLaVa endpoint with gradio stream for talk to image in front of UI
• [ ] Set Add Doc to Chat default to off until improved. maybe use accordion in case large text.
• [ ] Only generate image once for all_bot(), not super useful to generate for each
• [ ] Auto-response when done uploading if adding chat to doc
• [ ] Accordion away longer text for adding doc to chat. -- e.g. audio and then make from audio image, then repeats audio text.
• [ ] Make models on gradio endpoint
• [ ] Round-robin outer gradio since seem to be core limited and saturating that single core.
• [ ] remove posthog
• [ ] Need to put image stuff as endpoint, either separate gradio or part of llava.
• [ ] If text, can add to chat
• [x] distil whisper makes obvious mistakes compared to whisper large v3 from porche mp3

[pseudotensor]

https://www.adept.ai/blog/fuyu-8b

Fuyu’s caption: “A cake with writing on it that says congratulations kate and luke on your upcoming arrival.”

Question: “What is the highest life expectancy at birth of males?” Fuyu’s answer: “The life expectancy at birth of males in 2018 is 80.7”

OKVQA Question: “What instrument is the toy bear playing?” Fuyu’s answer: “snare” OKVQA Score: 0 (all reference answers are simply “drum”)

VQAv2 Question: “What type of foods are in the image?” Fuyu’s answer: “fish, carrots” VQAv2 Score: 0 (reference answers were “hot dogs”, “sausages”, and “healthy”)

Fuyu’s caption: “A nighttime view of Big Ben and the Houses of Parliament.” Reference captions: “A fast moving image of cars on a busy street with a tower clock in the background.” “Lit up night traffic is zooming by a clock tower.” “A city building is brightly lit and a lot of vehicles are driving by.” “A large clock tower and traffic moving near.” “there is a large tower with a clock on it.” CIDEr Score: 0.4 (No reference caption mentions Big Ben or Parliament)

Question: “Aidan Gillen acted in how many series?” Fuyu’s answer: “2”

Question: “Find missing data of the sequence 24, _ ,32, 33, 42?” Fuyu’s answer: “29”

Question: “What was the fair amount of paid vacation days in the UK?” Fuyu’s answer: “28”

Question: “Which is the metro in California that has a good job Outlook?” Fuyu’s answer: “Los Angeles”

Question: “What was the pack spinner capacity?” Fuyu’s answer: “118 packs.”

Question: “What letter does a keel-shaped cross-section look like?” Fuyu’s answer: “The letter V”

Question: “If in the food web shown in the diagram, Douglas fir tree needles are absent, which organism would starve?” Fuyu’s answer: “Red tree vole”

Question: “is the 2nd email starred? [‘yes’, ‘no’]” Fuyu’s answer: “no”

Question: “is La Taqueria north of the 24th St Mission Bart station?” Fuyu’s answer: “no”

[pseudotensor]

According to the table below, which food is the most likely cause of the outbreak of food poisoning: A. Cold chicken B. Potato salad C. Egg sandwiches D. Fruit pie and cream

B

---

Answer the following MMMU question based on the image.

Janet Ludlow’s firm requires all its analysts to use a two-stage dividend discount model (DDM) and the capital asset pricing model (CAPM) to value stocks. Using the CAPM and DDM, Ludlow has valued QuickBrush Company at $63 per share. She now must value SmileWhite Corporation. Calculate the required rate of return for SmileWhite by using the information in the following table:

A. 14% B. 15% C. 16%

C: 16% Answer: C

---

Table 11.47 provides a recent survey of the youngest online entrepreneurs whose net worth is estimated at one million dollars or more. Their ages range from 17 to 30. Each cell in the table illustrates the number of entrepreneurs who correspond to the specific age group and their net worth. We want to know whether the ages and net worth independent. $\chi$^2 test statistic = __

A. 1.56 B. 1.76 C. 1.96 D. 2.06

B. 1.76 Answer: B

---

[pseudotensor]

28.01 m/s