2021-02-01 - KDB Project Call Meeting Minutes

alvin-c-shih commented 3 years ago

Date

Monday, February 01, 2021 - 9:30am EST / 2:30pm BST

// First Monday of every month

Attendees

Fullname	Affiliation	GitHub Username
James McLeod	FINOS	@mcleo-d
Alvin Shih	Morgan Stanley	@alvin-c-shih
Peter Gyorok	Morgan Stanley	@gyorokpeter
Aaron Davies	Morgan Stanley	@adavies42

Meeting notices

FINOS Project leads are responsible for observing the FINOS guidelines for running project meetings. Project maintainers can find additional resources in the FINOS Maintainers Cheatsheet.
All participants in FINOS project meetings are subject to the LF Antitrust Policy, the FINOS Community Code of Conduct and all other FINOS policies.
FINOS meetings involve participation by industry competitors, and it is the intention of FINOS and the Linux Foundation to conduct all of its activities in accordance with applicable antitrust and competition laws. It is therefore extremely important that attendees adhere to meeting agendas, and be aware of, and not participate in, any activities that are prohibited under applicable US state, federal or foreign antitrust and competition laws. Please contact legal@finos.org with any questions.
FINOS project meetings may be recorded for use solely by the FINOS team for administration purposes. In very limited instances, and with explicit approval, recordings may be made more widely available.

Minutes

(10 min) Convene, roll call, welcome new people.
- [ ] Display FINOS Antitrust Policy summary slide
- [ ] Review Meeting Notices (see above)
(5 min) Approve previous meeting minutes.
- Approved by acclamation.
(5 min) Kdb Studio updates
- Pending pull requests from new contributor @punx120.
- Set limit on number of tabs.
- Two tabs per table.
- GUI tests working.
- CI logs don't really convey it.
- Can see it undo / redo.
- Y / N instead of Alt-Y / Alt-N for confirmation dialogs.
  - Required NetBeans changes to propagate events up the hierarchy.
(5 min) Discuss re-sync Kdb Studio NetBeans with Apache project?
- https://github.com/finos/kdb-studio/tree/master/src/org/netbeans/editor
- https://github.com/apache/netbeans/tree/master/ide/editor.lib/src/org/netbeans/editor
- No serious activity as of 3 years ago.
- Better to spend the time finding a more actively-maintained GUI framework.
(10 min) dep.q bootstrap / standard wrapper script and environment variables.
- Some questions about how much use other firms make use of QINIT env var.
- Cleaner if dep.q could know the path name by which it was loaded ( \l ).
- Might have to force the user to use absolute path name.
(20 min) Shielding downstream processes from seeing HDBs in inconsistent state?
- Turns out the target use case involves replication with rsync as well.
- Vanilla "tick" architecture doesn't append to files in HDB.
- https://rsnapshot.org/ and hdb_root symlink could work for that.
- Combine with incremental HDB loader / unloader.
  - i.e. Can specify expected new partition, or partition to roll off.
  - One exists at Morgan Stanley which could be refined for contribution if there were potential testers / users.
- More advanced plants do append to files.
- q knows to take the minimum count across column vectors.
  - Need to verify that it patches the count after appending data.
  - But rsync wouldn't respect special ordering.
- Only a file system which supports snapshots can cover all angles.
- Reluctance to engineer something from scratch that isn't a 100% solution.
- For replication, perhaps SilverKing could be used instead:
  - https://github.com/morganstanley/SilverKing
(5 min) AOB, Q&A, Adjourn.