[Bug]: A recent commit removed a popular example linked across various posts

[AyushExel]

Bug Description

Recently, @raghavdixit99 from LanceDB team contributed a multi-modal example. PR. Which was also put out on social media by llama-index handles and reshared by LanceDB. For example, here are some posts by @jerryjliu (twitter) , LinkedIn post by Llama-index handle

Now these links go to 404s. The commit that removed this example - https://github.com/run-llama/llama_index/commit/369973f4e8c1d6928149f0904b25473faeadb116#diff-ce50012ccb4962d4ff93caf69548063d393db9c87548a8263087fd0b93ac34e4

A few users have reported this, and we think that this might have been deleted by mistake in the previous major refactoring efforts. Can we add it back asap? thanks!

Version

0.10.1

Steps to Reproduce

https://docs.llamaindex.ai/en/stable/examples/multi_modal/multi_modal_video_RAG.html

Relevant Logs/Tracbacks

No response

[dosubot[bot]]

🤖

I understand the inconvenience caused by the removal of the multi-modal example. It seems like it was removed in a recent commit during a major refactoring.

To restore the file, you can revert the commit that removed the file. Here are the steps you can follow:

1. Identify the commit that removed the file. You can do this by using the git log command with the --diff-filter=D option which shows only deleted files, and the --summary option which shows more information about the commit:

git log --diff-filter=D --summary

Look for the commit that removed the file docs/examples/multi_modal/replicate_multi_modal.ipynb.

2. Once you have the commit hash, you can revert that commit. This will create a new commit that undoes the changes made in the commit you're reverting. Replace commit_hash with the actual commit hash:

git revert commit_hash

3. Finally, push the changes to the remote repository:

git push origin main

Replace main with the name of the branch you're working on if it's not main.

Please note that this will only work if the file was removed in a separate commit. If the file was removed in a commit that also made other changes you want to keep, you'll need to manually restore the file.

As for the content of the removed multi-modal example, it was a Python notebook that demonstrated how to use the MultiModal LLM class for image understanding/reasoning with the LlaVa-13B, Fuyu-8B, and MiniGPT-4 models. The notebook included code for installing and initializing Replicate, downloading and loading images, visualizing images, providing various prompts to test different Multi Modal LLMs, generating image reasoning from different LLMs with different prompts for different images, displaying sampled responses from Multi-Modal LLMs, and human labeling the correctness and relevance of the Multi-Modal LLM reasoning results.

I hope this helps. If you have any other questions or need further clarification, feel free to ask.

Sources

• docs/examples/multi_modal/replicate_multi_modal.ipynb

#### About Dosu

This response is meant to be useful and save you time. It is **not meant to be a precise solution**, but rather a starting point for your own research. Help me be more useful! Please leave a 👍 if this is helpful and 👎 if it is irrelevant. If you want to continue the conversation, start your reply with @dosu-bot.

[logan-markewich]

Yup, we are working on bringing it back, thanks @AyushExel

[hatianzhang]

@AyushExel pls checkout https://github.com/run-llama/llama_index/pull/10598

[logan-markewich]

This has been fixed