course: Advanced RAG implementation

[parambharat]

This PR contains the course work and related code for the RAG-IRL course.

[review-notebook-app[bot]]

Check out this pull request on 

See visual diffs & provide feedback on Jupyter Notebooks.

---

Powered by ReviewNB

[ayulockin]

@parambharat shouldn't we move the data dir to an artifact or as weave dataset?

[ayulockin]

nit: how about we use the naming of the notebooks like - 00_name.ipynb, 01_name1.ipynb, etc?

[ayulockin]

The data that we are downloading contains only .md file format?

[socket-security[bot]]

🚨 Potential security issues detected. Learn more about Socket for GitHub ↗︎

To accept the risk, merge this PR and you will not be notified again.

Alert	Package	Note	Source	CI
Obfuscated code	pypi/orjson@3.10.7	Confidence: 0.80 Location: Package overview	rag-advanced/requirements.txt	⚠︎

View full report↗︎

Next steps

What is obfuscated code?

Obfuscated files are intentionally packed to hide their behavior. This could be a sign of malware.

Packages should not obfuscate their code. Consider not using packages with obfuscated code

Take a deeper look at the dependency

Take a moment to review the security alert above. Review the linked package source code to understand the potential risk. Ensure the package is not malicious before proceeding. If you're unsure how to proceed, reach out to your security team or ask the Socket team for help at support [AT] socket [DOT] dev.

Remove the package

If you happen to install a dependency that Socket reports as Known Malware you should immediately remove it and select a different dependency. For other alert types, you may may wish to investigate alternative packages or consider if there are other ways to mitigate the specific risk posed by the dependency.

Mark a package as acceptable risk

To ignore an alert, reply with a comment starting with @SocketSecurity ignore followed by a space separated list of ecosystem/package-name@version specifiers. e.g. @SocketSecurity ignore npm/foo@1.0.0 or ignore all packages with @SocketSecurity ignore-all

• @SocketSecurity ignore pypi/orjson@3.10.7

[socket-security[bot]]

New dependencies detected. Learn more about Socket for GitHub ↗︎

Package	New capabilities	Transitives	Size	Publisher
pypi/blingfire@0.1.8	filesystem	0	104 MB	jiamguo, microsoft, sergeialonichau
pypi/bm25s@0.2.0	environment, eval, filesystem	0	209 kB	xhluca
pypi/cohere@5.9.2	environment, filesystem, network	0	1.02 MB	1vn, GangGreenTemperTatum, billytrend-cohere, ...1 more
pypi/fasttext-langdetect@1.0.5	environment, filesystem, network	0	46.7 kB	zafercavdar
pypi/levenshtein@0.25.1	filesystem, shell, unsafe	0	3.57 MB	maxbachmann
pypi/markdown-it-py@3.0.0	eval, filesystem, shell Transitive: environment, network, unsafe	+402	2.38 GB	cjsewell, ebp-bot
pypi/numpy@1.26.4	environment, eval, filesystem, network, shell, unsafe	0	100 MB	charlesr.harris, matthew.brett, mattip, ...2 more
pypi/pymdown-extensions@10.9	environment, filesystem, network Transitive: eval	+53	94.9 MB	facelessuser
pypi/pystemmer@2.2.0.1	environment, filesystem, network	0	943 kB	felixonmars, richardb
pypi/python-dotenv@1.0.1	environment, eval, filesystem, shell Transitive: network, unsafe	+6	1.88 MB	bbc, theskumar
pypi/python-frontmatter@1.1.0	filesystem Transitive: environment, eval, network, shell, unsafe	+93	560 MB	eyeseast
pypi/ranx@0.3.20	filesystem, network Transitive: environment, eval, shell, unsafe	+214	831 MB	AmenRa
pypi/rouge@1.0.1	filesystem Transitive: environment	+2	218 kB	pltrdy
pypi/syncer@2.0.3	filesystem	0	37.7 kB	miyakogi

View full report↗︎