2023-12-11 - KDB Project Call Meeting Minutes

alvin-c-shih commented 9 months ago

Date

Monday, December 11, 2023 - 9:30am ET / 2:30pm UK

// Second Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
James McLeod	FINOS	@mcleo-d
Jo Shinonome	ExeQution Analytics	@jshinonome
Aaron Davies	Morgan Stanley	@adavies42
Brian Runk	Morgan Stanley
Callum McCrea	Morgan Stanley
Connor Gervin	KX Systems	@Connor-Gervin
Daya Sunkara	Morgan Stanley
Jerry Fleming	Morgan Stanley
Karl Moll	FINOS	@karlmoll
Peter Gyorok	KX Systems	@gyorokpeter
Ross Duffy	Morgan Stanley	@rdffy
Utsav Parashar	Morgan Stanley
Alvin Shih	Morgan Stanley	@alvin-c-shih
Callum McCrea	Morgan Stanley
Niti Saluja	Morgan Stanley

Meeting notices

FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.
All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.
FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact legal@finos.org with any questions.
FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

(5 min) Convene, roll call, welcome new people.
[ ] Display FINOS Antitrust Policy summary slide
[ ] Review Meeting Notices (see above)
(5 min) Approve previous meeting minutes.
(10 min) Discuss benefits of Rust integration based on Jo's experience interfacing with Pola.rs with q.
- https://pypi.org/project/kola/
- https://github.com/jshinonome/kola (currently private)
- pip install blocked by code scanning tools since no license specified.
- Deserializer finds subvectors and processes them in separate threads using Rust's .par_iter().
- Can be 2x faster than PyKX serialization in some cases.
- Since q allocates separate memory pools per thread, probably an architectural change to adopt this in c.o.
- Rust is not a supported language at many banks.
(30 min) Discuss KDB.AI "Vector Lifecycle Management" slide.
- Since KDB.AI is "bring your own model", easiest to start from model benchmarks.
- Embeddings: MTEB: Massive Text Embedding Benchmark
  - https://huggingface.co/spaces/mteb/leaderboard
- Tutorial on fine tuning text embeddings:
  - https://docs.llamaindex.ai/en/latest/examples/finetuning/embeddings/finetune_embedding.html
- Open LLM Leaderboard:
  - https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard
- KDB.AI pattern matching example:
  - https://github.com/KxSystems/kdbai-samples/tree/main/pattern_matching
  - Would be nice if a time series transformer example were included as well.
- Not clear what on-prem LLM server infrastructure is recommended to go with KDB.AI.
- privateGPT is a minimal codebase demonstrating RAG concepts.
(5 min) AOB, Q&A, Adjourn.
- Introduction to Karl Moll from FINOS - new Technical Project Advocate.
- Has interest an AI topics including model licensing.
- PR needs review: https://github.com/finos/kdb/pull/98