2021 Jupyter Widgets Dev Meetings

jasongrout commented 3 years ago

Here is a record of the agenda/minutes for our bi-weekly meeting. Everyone is welcome to join.

Let's avoid using this thread for discussion. If you'd like to discuss something in the minutes, open a separate issue and reference this thread.

Meeting Notes

jasongrout commented 3 years ago

02 Feb 2021

3pm UTC (Local time)

(This meeting was set up and discussed on Gitter here and here)

Agenda

Background on 8.0
high-level goals
summary of current state of 8.0 release
triage of current 8.0 issues
discussion of timeline
Should we publish widgetsnbextension 4, cutting out the notebook dependency, before ipywidgets 8? See https://github.com/jupyter-widgets/ipywidgets/issues/2840#issuecomment-760158213 and https://github.com/matplotlib/ipympl/issues/34
Meetings moving forward

Minutes

Attending
- Jason Grout @jasongrout
- Carol Willing @willingc
- Vidar Tonaas Fauske @vidartf
- Matthew Seal @mseal
- Ian Hunt-Isaak @ianhi
- Alex Cabrera @cabreraalex
- Itay Dafna @ibdafna
- Matt Craig @mwcraig
- mariana meireles @marimeireles
- Martin Renou @martinRenou
- Maarten Breddels @maartenbreddels
- David Brochart @davidbrochart
- Matt Hong @matt1hong
- Jeremy Tuloup @jtpio
Introductions:
- Good mix of new and old faces
8.0 Summary:
- Workshop last year in January
- Development has since stalled due to shifting priorities
- Current issues on 8.0 milestone: https://github.com/jupyter-widgets/ipywidgets/issues?q=is%3Aopen+is%3Aissue+milestone%3A8.0
- master is 8.0, and we have a 7.x branch
Any other main things in 8.0
- Persistence of image for graphic widgets (perhaps 8.x?)
- Real-time collaboration on widgets with multiple clients
- Sylvain and Quantstack working on RTC, possibly for ipywidgets 9.0
8.0 Issue Triage: all issues were assigned to someone.
Further meetings: we will meet every other week. Jason is setting up a poll for a time.

jasongrout commented 3 years ago

18 Feb 2021

Attendees: Jason, Maarten, Jeremy, Ian, Sylvain, Martin, Itay

Jason
Jeremy
- New cookiecutter based tutorial: https://ipywidgets.readthedocs.io/en/latest/examples/Widget%20Custom.html
- We should try to finish and merge the 3.0 PR: https://github.com/jupyter-widgets/widget-ts-cookiecutter/pull/83
Itay
- Modernizing our python packaging practices: https://github.com/jupyter-widgets/widget-cookiecutter/pull/87
- A suggestion to use setuptools_scm
Ian
- custom ipywidget howto into docs?
- Transfer to jupyter-widgets org
Maarten
- State sync bug https://github.com/jupyter-widgets/ipywidgets/issues/3111
  - Related issue on echoing comm messages to all clients: https://github.com/jupyter/jupyter_client/issues/263
- ~~(post 8.0.0) Only save visible widgets, and save by default: https://github.com/jupyter-widgets/ipywidgets/pull/3114~~
- ~~(post 8.0.0) Embed mime bundles: https://github.com/jupyter-widgets/ipywidgets/pull/3107~~

Discussion

widgets.register what is it for?
- should it be default in the cookiecutter? - no
- should be better documented - Ian open an issue.
Triage 8.0 issues

ianhi commented 3 years ago

4 Mar 2021

Attendees: @jasongrout, @vidartf, @maartenbreddels, @ianhi, @ibdafna, @jtpio, @marimeireles

ian
- What is advice for people who want blocking widgets
  - (SO + issue)
  - See https://ipywidgets.readthedocs.io/en/stable/examples/Widget%20Asynchronous.html
  - Perhaps we change the kernel protocol to allow the kernel to process comm messages even if it is not idle (for example, if a cell has an await)?
  - We could ship the utility functions in the widget async docs, and make some more examples using them. Especially with dependencies on modern Python + ipykernel, this is more feasiable than before.
  - Make async waiting easier to use - make docs more approachable, ship utility function (ian make issue)
- Automated releasing secrets? who can add them? https://github.com/jupyter-widgets/jupyterlab-sidecar/pull/62
- We could release based on setting a tag. That makes it very easy, maybe too easy?
- We could release based on drafting a GitHub release.
- Ian and Jason getting together to explore this.
- [not discussed] unify cookiecutter? https://github.com/jupyter-widgets/team-compass/issues/4
Maarten
- Saving widget state: https://github.com/jupyter-widgets/ipywidgets/pull/3114
Discussion
- ipywidgets contrib
- Perhaps open a repo or new github org. Things are merged basically automatically, with very minimal vetting.

jasongrout commented 3 years ago

18 Mar 2021

Attendees: @jasongrout, @SylvainCorlay, @ianhi, @jtpio

Jason
- 8.0.0a4 (supporting jlab 3) was released 22 Feb
- Traitlets 4 vs 5: https://github.com/jupyter-widgets/ipywidgets/pull/3110 - Sylvain looking into it.
Ian
- Making 8.0 happen? (We're going to keep plugging away at it, no firm timeline, dependent on how much work people put into the issues and PRs on the milestone)
- New Issue Labels? https://github.com/jupyter-widgets/ipywidgets/issues/3161
  - Yes
Jeremy
- Initial steps for a widget examples repo: https://github.com/ianhi/custom-ipywidget-howto/pull/13
  - Plan to move to jupyter widgets organization as it gets polished
- Update to TypeScript 4.2? Should this go in before 8.0? https://github.com/jupyter-widgets/ipywidgets/pull/3162
  - Yes

What is the status of pythreejs? It is now a prebuilt extension compatible with JupyterLab 3.

Meeting times: We decided to move to a weekly meeting schedule to help development momentum, and re-evaluate the time to better accommodate those that are actually coming to the meetings. Since we're in the middle of a confusing time where some of us are on Daylight Saving time and others aren't, we'll keep the 7am Pacific Daylight Time meeting for Thursday, 25 Mar. Jason will send out a poll for a new meeting time for a weekly meeting for the following week.

jtpio commented 3 years ago

25 Mar 2021

Attendees: @jtpio, @jasongrout, @vidartf

Jeremy
- Export LabWidgetManager and KernelWidgetManager: https://github.com/jupyter-widgets/ipywidgets/pull/3166
- Revive "Restore widgets in batches" PR? https://github.com/jupyter-widgets/ipywidgets/pull/2765
Vidar
- Is this ok as is, or does it need any further changes? :)
  - https://github.com/jupyter-widgets/ipywidgets/pull/2972
  - https://github.com/jupyter-widgets/ipywidgets/pull/2715
Discussion
- Time change - new poll going out about a time for the meeting

jtpio commented 3 years ago

01 Apr 2021

Attendees: @jtpio, @ianhi, @jasongrout, @sylvaincorlay, @blois

Jeremy:
- Thanks Mehmet for adding visual regression testing: https://github.com/jupyter-widgets/ipywidgets/pull/3172
- Martin did something similar for bqplot: https://github.com/bqplot/bqplot/pull/1315
Ian:
- Blocking? https://github.com/ianhi/custom-ipywidget-howto/issues/17
Discussion
- Time change poll about a new time for the meeting
- Blocking
  - https://github.com/ipython/ipykernel/pull/589
  - Wrap around stdin to get blocking? This is what google colab does:
  - https://github.com/googlecolab/colabtools/blob/main/google/colab/_message.py
  - Can possibly think about it as we have rich output, but not rich input.
- 8.0 release. Stability of ipywidgets for breaking into multiple releases to get 8.0 done?

jtpio commented 3 years ago

08 Apr 2021

Attendees: @ianhi, @jtpio

Discussions
- Next meeting time results: http://whenisgood.net/nx49zs8/results/538da5r
- Best candidate: Tuesdays at 09:00 am Pacific

jtpio commented 3 years ago

13 Apr 2021

Attendees: @ianhi, @jasongrout

Discussions
- Deep dive on potential of using stdin as a mechanism for blocking until a user interacts with a widget.
- Ian will create an issue summarizing everything that can be used as a starting place for further investigations.

jtpio commented 3 years ago

27 Apr 2021

Attendees: @jtpio, @ibdafna, @ianhi, @vidartf

Discussions
- Async widget methods and dispatching GUI messages asynchronously:
  - https://github.com/ipython/ipykernel/issues/646
  - https://github.com/ipython/ipykernel/pull/589
- ~~Status of ipywidgets 8.0 release~~

jtpio commented 3 years ago

04 May 2021

Attendees: @ibdafna, @ianhi, @vidartf

Ian: Changing defaults?
- https://github.com/jupyter-widgets/ipywidgets/issues/3193
Vidar:
- Maarten posted this on gitter https://github.com/jupyter-widgets/ipywidgets/pull/3195

jtpio commented 3 years ago

18 May 2021

Attendees: @jtpio, @ianhi, @jasongrout, Ilya

Ilya: async messaging: https://github.com/ipython/ipykernel/pull/589 https://github.com/ipython/ipykernel/issues/646
- imjoy: https://github.com/imjoy-team/imjoy-rpc
- https://github.com/jupyter-widgets/ipywidgets/issues/3039
8.0 timeline
Ian: widget persistence + matplotlib lots of discussion on mpl gitter (https://gitter.im/matplotlib/matplotlib?at=609d4203c12aec4aa2c2346f)

jtpio commented 3 years ago

01 June 2021

Attendees: @vidartf, @jasongrout

8.0 triage

jtpio commented 3 years ago

08 June 2021

Attendees: @vidartf, @jtpio

Quick update on outstanding work on 8.0

jtpio commented 3 years ago

15 June 2021

Attendees: @jtpio, @vidartf, @ibdafna

Dependency updates PRs by Jason:
- TypeScript 4.3: https://github.com/jupyter-widgets/ipywidgets/pull/3162
- Webpack: https://github.com/jupyter-widgets/ipywidgets/pull/3211
Quick pass on the new issues to assign them to the 8.0 milestone if needed

jtpio commented 3 years ago

22 June 2021

Attendees: @jtpio, @vidartf, @ibdafna, @jasongrout

NoUISlider upgrade PR: https://github.com/jasongrout/ipywidgets/pull/4

jtpio commented 3 years ago

29 June 2021

Attendees: @jasongrout, @davidbrochart, @ilyabo, @ibdafna

Welcome Itay (@ibdafna) as an ipywidgets maintainer!
Scipy 2021 tutorial is in two weeks, based on ipywidgets 7.6.3, JupyterLab 3.0 (Matt Craig, Itay Dafna, Mariana, Martin, Youness)
- This year emphasizing additional widget libraries, like ipycanvas, ipycytoscape, ipydatagrid, etc.
8.0a5 is out: lots of package upgrades, so please test third-party widgets
@ilyabo, @davidbrochart: Async widgets: we have a modified kernel now that enables async processing of widgets.
- Each cell is launched as an async function and is launched as a task. You can run several cells concurrently. If there is purely synchronous code, it runs as normal. Essentially the top-level await is converted to an await inside an async function, so await returns control to the event loop.
- https://github.com/davidbrochart/akernel
- https://github.com/ipython/ipykernel/issues/696
- There is a pattern to force "synchronous" running of successive cells with await __task__()

jasongrout commented 3 years ago

6 July 2021

Attendees: @jasongrout, @vidartf, @jtpio,

ipywidgets tutorial update (next week)
ipywidgets community update
ipywidgets 8.0 triage

jasongrout commented 3 years ago

13 July 2021

Attendees: @jasongrout, @vidartf, @ibdafna

@ibdafna: ipywidgets tutorial report (Monday morning at Scipy)
- We cleaned up the tutorial repo, updated the binder, etc.
- Didn't show some of Maarten's widgets because they weren't working
- Went well. Generated buzz on Twitter. It was a new audience, with many people exposed to ipywidgets for the first time. About 100 attendees.
- Need short introduction to decorators
- The styling/layout section was a bit long. Instead, just give a few examples, then jump in with examples and day-to-day issues people will face.
- We'll continue refreshing and rotating the list of ipywidgets libraries we are showing each year.
- The online platform worked well, the platform worked pretty well. The platform "Q&A" section was a bit awkward to use.
- Lots of questions, especially compared to last year.
ipywidgets 8.0 triage
- Went through recent PRs, reviewed and merged some, and assigned out others.
https://codepath.org/ - interesting mentoring opportunity

jtpio commented 3 years ago

03 August 2021

Attendees: @jasongrout, @vidartf, @ibdafna

jtpio commented 3 years ago

10 August 2021

Attendees: @jasongrout, @vidartf, @ibdafna

Itay:

https://github.com/jupyter-widgets/ipywidgets/pull/2728

Vidar:

Github lints ("Unchanged files with check annotations")
Should we fix typos in help string retoractively in specs? https://github.com/jupyter-widgets/ipywidgets/pull/3246

Triage:

https://github.com/jupyter-widgets/ipywidgets/issues/3247

jtpio commented 3 years ago

17 August 2021

Attendees: @vidartf, @jasongrout, @ibdafna, @blois

Pete:

Colab introducing support for custom widgets
API is based on es6 modules for compatibility
Proof of concept at https://github.com/googlecolab/colab-cdn-widget-manager, has working example. Feel free to reach out with bugs or questions.

Itay:

TS cookiecutter maintenance - Itay volunteering, and Vidar will help him come up to speed.

Triage for 8.0:

jtpio commented 3 years ago

24 August 2021

Attendees: @vidartf, @jasongrout

Triage for 8.0:

Discussion around extending widgets support to JupyterLab code consoles.

jtpio commented 3 years ago

31 August 2021

Attendees: @vidartf, @jasongrout, @ibdafna

https://github.com/jupyter-widgets/ipywidgets/pull/3262

Triage for 8.0:

Itay:

8.0.0a6 prerelease due out this week
7.1.x patch release with ipython_genutils dependency

Vidar: #2259, #2800 Itay: #3230, #3247 Jason: #2762

jtpio commented 3 years ago

07 Sep 2021

Attendees: @jasongrout

jtpio commented 3 years ago

14 Sep 2021

Attendees: @vidartf, @jtpio, @ianhi, @ibdafna

Triage for 8.0

Add dragging behaviour properties to sliders: #2834
- Rebase + rename to american spelling
- Merge and do a final review after having it in alpha
If we include #2762, we should also consider #2605
- Current proposal: Add three new promises: attached, layedOut, shown. Then deprecate displayed, and have that resolve at the same time as attached for now (retaining its current behavior). This will allow for third-party libraries to update on their own time, but still resolve the ambiguity.

jtpio commented 3 years ago

21 Sep 2021

Attendees: @jtpio, @martinRenou, @vidartf, @jasongrout, @ibdafna

Martin:
- Select widget: prevent arbitrary selection if there is currently no selection and the option list changes https://github.com/jupyter-widgets/ipywidgets/pull/3284
- Doc fixing, fix "process.env is undefined" issue which prevented the HTMLManager to render widgets https://github.com/jupyter-widgets/ipywidgets/pull/3283
- widgetsnbextension: Throw an exception if the widget fails to render, this allows the Notebook to fallback on other mimetypes repr https://github.com/jupyter-widgets/ipywidgets/pull/3280 (should be tested with current Notebook version/should do a Notebook version check in widgetsnbextension?)
Jeremy:
- rebased Itay's PR: https://github.com/jupyter-widgets/ipywidgets/pull/2834
Triage for 8.0:
- Are there any issues that will need a PR?
  - #2762
  - #3247
- Are there any unassigned PRs?
- Any assistance needed on assigned PRs?

jtpio commented 3 years ago

28 Sep 2021

Attendees: @martinRenou, @vidartf, @jasongrout, @SylvainCorlay

#3280
- Can we confidently make a minor release of widgetnbextension? Probably best to branch from last
#3021
- This PR does not change the current logic for ipywidgets. It is adding a new Comm entry point for Voila to fetch all widgets models at once.

jtpio commented 3 years ago

05 Oct 2021

Attendees: @vidartf, @jasongrout, @ibdafna

VS Code support
- Still support 7.x
- Support most widgets except VPython
- Catboost -
Triage for 8.0:
- Are there any issues that will need a PR?
- Are there any PRs without an assigned reviewer?
- Any assistance needed on assigned PRs?
- Which issues should be moved to 8.1?

jtpio commented 3 years ago

12 Oct 2021

Attendees: @vidartf, @jasongrout, @martinRenou, @piiq, @jtpio, @ibdafna

Itay show and tell
- https://github.com/ibdafna/webdash
Introductions
Triage for 8.0:
- https://github.com/jupyter-widgets/ipywidgets/pull/3021
  - Additive, so no need to explicitly target 8.0. Will target 7.x and 8.x
- Are there any issues that will need a PR?
- Are there any PRs without an assigned reviewer?
  - https://github.com/jupyter-widgets/ipywidgets/pull/3271
  - https://github.com/jupyter-widgets/ipywidgets/pull/3286
- Any assistance needed on assigned PRs?
- Do not wait for the "displayed" promise to be resolved before applying the layout https://github.com/jupyter-widgets/ipywidgets/pull/3288
- Which issues should be moved to 8.1?

jtpio commented 3 years ago

19 Oct 2021

Attendees: @jtpio, @martinRenou, @jasongrout, @sylvaincorlay

8.0.0a6 on conda:
- PR to update to 8.0.0a6: https://github.com/conda-forge/ipywidgets-feedstock/pull/71
- Follow-up to remove the Python 3.10 upper bound: https://github.com/conda-forge/ipywidgets-feedstock/pull/72
Bug fix https://github.com/jupyter-widgets/ipywidgets/pull/3296
Fech all widgets in one go on the control channel: https://github.com/jupyter-widgets/ipywidgets/pull/3021
Hold sync during set_state https://github.com/jupyter-widgets/ipywidgets/pull/3271
Jupyter Releaser:
- Started by David in https://github.com/jupyter-widgets/ipywidgets/pull/3298
- How do we want to version the packages?
- Do we want to be able to release packages indepedently? ipywidgets, jupyterlab_widgets, widgetsnbextension -> Yes
- Currently bumping versions is like a complex decision tree
  - We could start by documenting how versions are bumped. For example how to decide whether this is a minor version and what updating a given package means for the other packages that depend on it.
  - The releaser takes a spec as input. So we would have to encode the bump we would like to do, and let the bump script update the right packages.
  - There is also the protocol version as another version to consider. This one could be versioned manually.

jtpio commented 3 years ago

26 Oct 2021

Attendees: @ibdafna, @martinRenou, @vidartf, @jasongrout, @trungleduc

Merge? https://github.com/jupyter-widgets/ipywidgets/pull/3271
Two new PRs this week:
- https://github.com/jupyter-widgets/ipywidgets/pull/3301
  - Possible choices for dir name
  - python
  - python_packages
  - pypackages
- https://github.com/jupyter-widgets/ipywidgets/pull/3302
Trung: Fallback widget when the widget fails to render. Following up https://github.com/jupyter-widgets/ipywidgets/pull/2960
Triage for 8.0:
- Are there any issues that will need a PR?
- Are there any PRs without an assigned reviewer?
- Any assistance needed on assigned PRs?
- Which issues should be moved to another milestone?

jtpio commented 3 years ago

02 Nov 2021

Attendees: @jtpio, @jasongrout, @vidartf, @ibdafna

Widgets in RetroLab
- Classic notebook Widgets menu:
- Save Notebook Widget State
- Clear Notebook Widget State
- Download Widget State
- Embed Widgets
- RetroLab widget menu options:
- Settings > Save Widget State Automatically (toggle)
- In classic notebooks, it is possible to author a widget in a notebook: https://ipywidgets.readthedocs.io/en/stable/examples/Widget%20Custom.html
This last week:
- Sylvain released widgetsnbextension 3.5.2 with https://github.com/jupyter-widgets/ipywidgets/pull/3290 and https://github.com/jupyter-widgets/ipywidgets/pull/3280 (first release since 3.5.1 in Jul 2019)
- Retrieve state on new comm channel: https://github.com/jupyter-widgets/ipywidgets/pull/3021 review
- Error Widget fallback: https://github.com/jupyter-widgets/ipywidgets/pull/3304: Itay assigned as reviewer
- https://github.com/jupyter-widgets/ipywidgets/pull/3301: Jason reviewing
- Trigger setLayout on before-attach? https://github.com/jupyter-widgets/ipywidgets/issues/2605
Releasing beta next week?
- We have PR for moving to Jupyter Releaser
- As discussed two weeks ago, we'll do a manual release and look at what needs to be done to bump package versions.

jtpio commented 3 years ago

09 Nov 2021

Attendees: @vidartf, @jasongrout, @ibdafna, @martinRenou, @jtpio

New issues last week:
- https://github.com/jupyter-widgets/ipywidgets/issues/3307
- https://github.com/jupyter-widgets/ipywidgets/issues/3306
Is this backwards compatible or not?
- https://github.com/jupyter-widgets/ipywidgets/issues/3282
  - We think this is probably backwards compatible. Jason is opening an issue in Lumino about this general pattern.
Review of PR from Trung Le Duc (Error widgets)
- https://github.com/jupyter-widgets/ipywidgets/pull/3304
  - There are a few outstanding questions in the PR review.
Review resolved ?
- https://github.com/jupyter-widgets/ipywidgets/pull/3021
8.0 triage:
- Seem very hard to achieve: https://github.com/jupyter-widgets/ipywidgets/issues/2605 Ok to drop?
Changelog:
- widgetnbextension needs changelog entry: https://github.com/jupyter-widgets/ipywidgets/compare/7.6.2...7.6.3
Beta release:
- Changelog this week
  - Jason to generate PR listing
  - Everyone fill out
- Next week, release beta the hour before meeting
Meeting: Change to an hour meeting

jtpio commented 3 years ago

16 Nov 2021

Attendees: @vidartf, @martinRenou, @SylvainCorlay, @jtpio, @ibdafna, @jasongrout

New issues/PRs since last meeting:

https://github.com/jupyter-widgets/ipywidgets/pull/3311
(not discussed) https://github.com/jupyter-widgets/ipywidgets/issues/3310
(not discussed) https://github.com/jupyter-widgets/ipywidgets/issues/3309

8.0 beta release party

jtpio commented 2 years ago

23 Nov 2021

Attendees: @vidartf, @martinRenou, @ibdafna,

New issues/PRs since last meeting:

Review needed:

jtpio commented 2 years ago

30 Nov 2021

Attendees: @vidartf, @ibdafna, @jtpio, @SylvainCorlay

8.0 release plans

Currently on track. We will all try to update a 3rd-party library to support 8.0 before next week, when we plan to do an RC unless there are any blockers.
New convenience trait/serializers for serializing full IEEE float values (i.e., NaN and infinity)
Introductions
- chadiabifadel

PRs

Merged Galata update: https://github.com/jupyter-widgets/ipywidgets/pull/3279
Releaser update: https://github.com/jupyter-widgets/ipywidgets/pull/3298 - needs another pass
https://github.com/jupyter-widgets/ipywidgets/pull/3302: restart checks, port to master
Allow Output.clear_output() to be thread-safe.

jtpio commented 2 years ago

7 Dec 2021

Attendees: @maartenbreddels, @ibdafna, @jtpio, @SylvainCorlay, @vidartf, @jasongrout

Front-end sync PR:

https://github.com/jupyter-widgets/ipywidgets/pull/3195
Long discussion about what this PR does, and decision to put in a default-off global switch and get it in for 8.0RC after review.

Issues:

(not discussed) https://github.com/jupyter-widgets/ipywidgets/issues/3322

Porting widgets to 8.0: will need to work on a migration guide. Current changelog: https://ipywidgets.readthedocs.io/en/latest/changelog.html#not-released-yet

jtpio commented 2 years ago

14 Dec 2021

Attendees: @vidartf, @ibdafna, @martinRenou, @jasongrout, @real-slim-chadi

Front-end sync PR
Typescript 4.5 update
RC:
- Jason working on a dependency update
- Maarten working on his PR
- We can release RC this week
Where to start contributing?
- https://github.com/jupyter-widgets/ipywidgets/blob/master/CONTRIBUTING.md
- Good first issues are tagged here: https://github.com/jupyter-widgets/ipywidgets/issues?q=is%3Aopen+is%3Aissue+label%3A%22good+first+issue%22
- @real-slim-chadi taking a look at the new contributor guide
Meeting next week (21 Dec)

jasongrout commented 2 years ago

21 Dec 2021

Attendees: @maartenbreddels, @ibdafna, @SylvainCorlay, @jasongrout

Jason: upgrading to TypeScript 4.5 has incompatibilities with older JupyterLab versions, so we hold off upgrading it in the RC.
Discussed Maarten's front-end sync PR. Sylvain and Itay will meet on Dec 22nd to run a a few final tests and, if not issues are found, merge and release RC0 :tada:

jupyter-widgets / team-compass