2023-05-15 - KDB Project Call Meeting Minutes

alvin-c-shih commented 1 year ago

Date

Monday, May 15, 2023 - 9:30am ET / 2:30pm UK

// Second Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
James McLeod	FINOS	@mcleo-d
Aaron Davies	Morgan Stanley	@adavies42
Peter Gyorok	KX Systems	@gyorokpeter
Ross Duffy	Morgan Stanley	@rdffy
Alvin Shih	Morgan Stanley	@alvin-c-shih
Callum McCrea	Morgan Stanley

Meeting notices

FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.
All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.
FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact legal@finos.org with any questions.
FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

(5 min) Convene, roll call, welcome new people.
[ ] Display FINOS Antitrust Policy summary slide
[ ] Review Meeting Notices (see above)
(5 min) Approve previous meeting minutes.
- Approved by acclamation.
(1 min) Updates on Anaconda.
- No one on the call with updates.
(10 min) Updates on PaKX / dep.q overlaps.
- PaKX more about packaging workflow.
- Directory structure.
- Manifest file.
- Only small bits of overlap with dep.q.
- Some wrappers around \l in PaKX.
- They'd benefit from the includefunctionality in dep.q.
- Will look for internal collaboration opportunity.
(5 min) CCLA / KX Open Source
- Still some administrative steps to be worked out on the CCLA.
- Some current KX projects under Apache 2.0 license:
- https://github.com/kxsystems/automl/
- https://github.com/KxSystems/kafka/
- https://github.com/KxSystems/arrowkdb/
- Having these under FINOS with KX as lead maintainer would make it much easier to receive PRs from developers at financial services companies.
- Reminder that MIT license does not require attribution whereas Apache 2.0 does.
(10 min) PyKX / verbose.q next steps.
- https://code.kx.com/pykx/1.4/api/q/q.html
- Comparison operator baked into the string:
- https://code.kx.com/pykx/1.4/api/query.html#pykx.query.SQL.prepare
- pykx.q.qsql.select(qtab, where=['col1=`a', 'col2<0.3'])
- Since most operators are read-only, maybe better to have a 'w' prefix to signify operators that could write over existing variables.
- Question about having non-namespaced verbose.k overwrite existing functions for easier debuggability.
- Load it when needed to help diagnose.
- Would be particularly helpful with trainees.
- Predicts much greater uptake with this.
- But won't help for select and other operations based on overloaded punctuation.
(5 min) Splaying from one HDB into another.
- One member has an HdbMerge utility.
- Possibly made safer with qclone.q.
- Horizon wrote their own since they were not aware.
- Based on "Mass ingestion through data loaders" article.
  - https://code.kx.com/q/wp/data-loaders/
  - https://github.com/kxcontrib/massIngestionDataloader
(5 min) Discuss possibility for a FINOS LLM Project.
- Colin Ebererhardt's post made the front page of Hacker News:
- "Re-implementing LangChain in 100 lines of code (scottlogic.com)"
  - https://news.ycombinator.com/item?id=35820931
  - https://blog.scottlogic.com/2023/05/04/langchain-mini.html
- Getting easier to fine tune LLMs for finance / fintech / regtech:
- "Hello Dolly: Democratizing the magic of ChatGPT with open models (databricks.com)"
  - https://news.ycombinator.com/item?id=35288063
  - https://www.databricks.com/blog/2023/03/24/hello-dolly-democratizing-magic-chatgpt-open-models.html
- Easiest to start under the Zenith SIG.
- https://github.com/finos/zenith
(5 min) AOB, Q&A, Adjourn.