Create RAG demo notebook

[erskine]

We would like to create a demonstration notebook which shows our ability to index content, and perform retrieval augmented generation.

Let's have the problem broken down into cells where one cell might accept a parameter for content to be indexed and then indexes the content into a delta table similar to XOI.

The next cell would accept a query as input, embeds the query, searches the content delta table, and then construct a prompt for an llm to interpret the answer(s) and return a response.

Think of the notebook cells in terms of discrete pieces of functionality - that is, the content index embedding cell should be able to evolve independently of the query processing cell. For that matter, the query processing cell could be split into embedding, searching, and prompt creation. Each of these parts should be tweakable independent of each other.

[ZoharKapach]

Link erik shared in slack: rag notebook