2023-10-09 - KDB Project Call Meeting Minutes

alvin-c-shih commented 1 year ago

Date

Monday, October 9, 2023 - 9:30am ET / 2:30pm UK

// Second Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
James McLeod	FINOS	@mcleo-d
Alvin Shih	Morgan Stanley	@alvin-c-shih
Jo Shinonome	ExeQution Analytics	@jshinonome
Peter Gyorok	KX Systems	@gyorokpeter
Ross Duffy	Morgan Stanley	@rdffy
Aaron Davies	Morgan Stanley	@adavies42
Gary Davies	Data Intellect	@drgdavies

Meeting notices

FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.
All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.
FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact legal@finos.org with any questions.
FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

(5 min) Convene, roll call, welcome new people.
[ ] Display FINOS Antitrust Policy summary slide
[ ] Review Meeting Notices (see above)
(5 min) Approve previous meeting minutes.
- Approved by acclamation.
(20 min) kuki Ecosystem
- re package released under GPL 3.0
- https://github.com/jshinonome/re
- Prevents adoption at financial services companies.
- FINOS projects are Apache 2.0 for this reason.
- Apple moving away from GNU:
  - https://meta.ath0.com/2012/02/05/apples-great-gpl-purge/
  - https://dev.to/bphogan/use-modern-bash-shell-on-macos-22a6
- Jo looking to develop a linter and formatter for q code.
- Would check where clauses of HDB queries for common gotchas.
- KX Developer already has a linter.
- No formal grammar for q.
  - Apter has a parser for k3:
  - https://nsl.com/k/kparse/kparse.k
- Miscellaneous ideas:
  - Leverage debugger info?
  - Extend the language with Typescript-style type annotations?
  - Expose \l functionality that breaks scripts into statements?
(5 min) PyKX Adoption
- Although more Pythonic, significant aspects of q language leak through.
- Thus, still a learning curve for users coming from pure Python background.
- Easier for those users if kdb hidden behind an API.
- For cases where a server is not required, Python users investigating DuckDB.
(5 min) Shakti status.
- STAC M3 benchmark not out yet.
- IPC format exists but might be subject to change.
(10 min) Command line flags to override module loading in dep.q?
- Came in handy for monkey patching JupyterQ.
- https://github.com/KxSystems/jupyterq/blob/master/kernelspec/kernel.json
- Might be too intrusive a change to force adoption of a FINOS command line parser.
- Consider doing this via environment variables.
- Interestingly -u 0 not documented:
- https://code.kx.com/q/basics/cmdline/#-u-usr-pwd-local
- https://github.com/KxSystems/jupyterq/blob/master/jupyterq_kernel.q#L288
- Back in the day, http://code.kx.com was a community-edited Wiki. :-)
(5 min) AOB, Q&A, Adjourn.