2022-05-09 - KDB Project Call Meeting Minutes

alvin-c-shih commented 2 years ago

Date

Monday, May 9, 2022 - 9:30am ET / 2:30pm UK

// Second Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
Julia Ritter	FINOS	@Julia-Ritter
Aaron Davies	Morgan Stanley	@adavies42
Peter Gyorok	Morgan Stanley	@gyorokpeter
Alvin Shih	Morgan Stanley	@alvin-c-shih
Jo Shinonome	Squarepoint Capital	@jshinonome
Gary Davies	AquaQ Analytics	@drgdavies

Meeting notices

FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.
All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.
FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact legal@finos.org with any questions.
FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Agenda

(5 min) Convene, roll call, welcome new people.
[x] Display FINOS Antitrust Policy summary slide
[x] Review Meeting Notices (see above)
[x] (5 min) Approve previous meeting minutes.
- Approved by acclamation.
[x] (5 min) kdb Studio Updates
- PR to change Ctrl+Delete to delete word instead of to end of line.
- https://github.com/finos/kdb-studio/pull/112
[x] (5 min) FINOS Structured Products?
- https://github.com/finos/structured-products
- Meeting was scheduled but interrupted.
- @Julia-Ritter oversees that project.
- Some information here: https://gitlab.com/finosfoundation/legend/financial-objects/structured-products
- Seems to be about modeling structured products and ingesting vendor data.
- See if someone from the kdb Project can listen in on a Structured Products call to determine relevance.
[x] (10 min) KX Insights Discussion
- https://kx.com/kx-insights/
- KX Insights documentation doesn't have a "beginning".
- Could benefit from organizing along the lines of https://documentation.divio.com/structure .
- Features in KX Insights not included with regular kdb:
- object storage, logging, REST API
- KX Insights Microservices inside a Docker container:
- API provided to communicating between microservices?
  - data access / data persistence
- Not many kdb teams asking for fine-grained containierization.
- access gateway
- eg. split up data based on location
- PyKX replacement for PyQ / qPython
- purportedly more efficient since it's a native implementation
- core operations run on q code
- ANSI SQL - Postgres-compatible driver
- ODBC driver is old
- Clients / Users are talking about it
- concern over massive migration effort
- some teams want to migrate their plants to cloud with minimal changes
- others interested in a more complete solution
- some PoCs in progress
- Would be nice to see STAC benchmarks of KX Insights.
- Evidence that it's still performant.
- Not clear how related it is to KX Data Refinery
- https://code.kx.com/q/architecture/examples/
- There were press releases about Reuters using that.
[X] (5 min) Data Quality API
- No one's had cycles to closely look at it yet.
- Ideas on what it might look like:
- Parameters like: table name, business day calendar(s), temporal column, key columns, function dictionary.
- How to deal with step changes? New data sources, mergers / acquisitions, schema migrations, etc.
[X] (5 min) Linux Foundation OpenSSF Best Practices Badge
- https://github.com/finos/kdb/issues/72
- Closed because WhiteSource does not support q and because there are no external dependencies.
- https://github.com/finos/kdb-studio/issues/104
- Ticket is still open. @Julia-Ritter will follow up with @TheJuanAndOnly99 .
- https://bestpractices.coreinfrastructure.org/en/projects
[X] (5 min) Opportunities for kdb open source?
- Maybe KX Insights shaking-up in the kdb world would make developers more willing to look past legacy code.
- Dependency loader combined with publishing modules on Anaconda might become more interesting.
- https://code.kx.com/q/interfaces/
- https://code.kx.com/q/github/
(5 min) AOB, Q&A, Adjourn.