Cleaning up and making Pyodide / JupyterLite installation maintainable

[miohtama]

Here is a task list to get the jupyterlite notebooks to production ready

• [ ] Make sure that we can use stock Pyodide installation instead of a custom build
  • [x] Take requests and pyarrow to main Pyodide repository / maintain separately in a single package installations to avoid a custom brittle build processes
  • [ ] Discuss mini spec what this would entail and create subtasks for both packages, also with some dummy test.html how to test
• [ ] Make sure that the following packages can be installed from PyPi (not necessarily runnable first) using micropip unless there is some serious blocker that prevents us doing this
  • [ ] trading-strategy
  • [ ] trade-executor
  • [ ] web3-ethereum-defi
  • [ ] web3
  • [ ] First get a standalone test page working with micropip installations - calls some trading-strategy and trade-executor from JavaScript and gets replies, like utility functions that do not really do anything
  • [ ] Then proceed to we can run some notebook code that executes a full example strategy with Plotly graphs output (depends on trade-executor)
  • [ ] Then get all this packaged nicely so that it can be consumed from JupyterLite
  • [ ] Document every step in the process with README how it was and why it was done that way

If any issues are encountered, consider first low hanging fruit approach to ignore any ImportError and enable the codepaths only after we know they are needed.

All the packages should be available on PyPi and pure Python packages. Only native dependencies should be web3 dependencies like pycryptodome.

[hieuh25]

Another wish from me: it would be nice to be able to install dev version of above packages (e.g: trading-strategy, trade-executor, etc) or others in the future without going through PyPI. I guess this should be easier with micropip than custom pyodide build but still want to make a comment here in case I forget.

[joemarshall]

@hieuh25 This should be much easier - as long as it's a wheel, you can micropip install it. I can happily install pyarrow now.