storybookjs / storybook

Storybook is the industry standard workshop for building, documenting, and testing UI components in isolation
https://storybook.js.org
MIT License
84.02k stars 9.23k forks source link

[Tracking] Reduce install footprint šŸ¾ #29038

Open vanessayuenn opened 2 weeks ago

vanessayuenn commented 2 weeks ago

šŸ§‘ā€šŸ¤ā€šŸ§‘ Who: @JReinhold and @ndelangen

This is a tracking issue for the Reduce install footprint šŸ¾ project. The purpose of this issue is to keep tracking of the overall status of the project and tasks, and plan everything around it.

See also #29072 which is a spike we'll be doing as part of this project to investigate how to move Storybook towards publishing ESM-only packages.

šŸ“¢ Want to help?

Make sure you read this issue thoroughly to understand what we want to achieve and how. Do not ask to be assigned to certain tasks, just do them. We won't "reserve" anything to potential contributors, that system rarely work. Help out with what you want, and report findings in this issue, eg. if you've identified potential optimisations in a package. If you open pull requests with your work make sure to reference this issue and tag @JReinhold.

āš ļø Problem

One of the biggest complaints about Storybook is that it's a big and heavy dependency to add to your project. There are muliple ways to interpret the frustration, but one of the most impactful improvements we can make is to reduce the install size of the core Storybook experience.

Throughout the current Storybook 8 releases we've already managed to cut the size significantly, eg. via #27039 and #28519. But there is plenty more work to be done - especially outside the core package - that will enable us to shrink Storybook even further.

šŸ Goals

The high-level goals of this project is to:

  1. Reduce the install size of "the core Storybook experience". That is, the packages that are included in a normal init process, such as storybook, the builders (Vite/Webpack), the renderers (React, Svelte, etc.) and the default addons.
  2. ... this includes reducing the dependency graph of mentioned packages, to speedup installation.
  3. Set long-term baselines and goals that will keep us in check, ensuring we don't regress the install-size later.
  4. Build and set up tooling to support these goals. We'll try to find ways that make it easier to maintain lean packages and reduce their footprint. This includes easy-to-access bundle and package analysis tools and reporters.
  5. Identify changes that require a major version bump. This project will conclude before the next major version of Storybook, so we can't make those changes now, but we can prepare them so they are ready when we're closer to the next major release.

This means we are not focusing on performance improvements nor reducing the size of a built Storybook. We still love those improvements, but they are not the major focus here.

šŸ“š Resources

šŸ“Š Spreadsheet with package stats

šŸ”¬ Methodology

Storybook is a complex mesh of over 30 packages, therefore analysing "Storybook's" install size will be tackled from two angles:

  1. E2E tests aka sandboxes: Storybook sandboxes represent real-world, minimal projects with Storybook installed. Storybook support countless project configurations, eg. A NextJS project, or a Vite-based Vue project. By initialising Storybook a top these minimal projects, we get a sense of what impact Storybook has on the overall node_modules size and the amount of dependencies added to the project. The upside of this perspective is that it directly focuses on the experience our users get. The downside of this approach - as with most E2E tests - is that it can be "flaky" because a lot of outside factors can impact the project's install size and dependency count. It's also a coarse metric, detecting significant size increases in sandboxes doesn't really help us identify where the increase is coming from. This brings us to...
  2. Unit tests aka packages: Each individual Storybook package will have its own metric on install size and dependency graph. Measuring and detecting size increases at the package-level makes it a lot easier to pinpoint the cause of it. But laser-focusing on packages in isolations can lead to work that makes little difference to the end-user, because they don't use the Storybook packages in isolation. Eg. removing a big dependency from @storybook/react-vite doesn't help if that dependency is still installed by @storybook/core.

Therefore we must keep both metrics in mind, to ensure we improve the experience for the end-user while still getting actionable results on the lower level.

We'll use a breadth-first approach when doing the optimisations across the packages. At the start of the project all, the integration packages have a single task (which also applies to the core): Identify potential optimisations. We'll do that first across all the packages on a high-level, to identify common patterns and find big wins first. This ensures that we don't laser focus on eg. removing 15 KB from @storybook/react when we could instead have removed 12 MB from @storybook/vue3-vite. With that said, there are already known big wins in the core packages that might get a higher priority than looking into some of the integration packages.

There are many approaches and tools to optimising package's size and dependencies and it's not a one-size-fits-all. https://e18e.dev/guide/cleanup.html is a good primer on how to approach it. At a high-level we'll:

  1. Use https://pkg-size.dev to identify and monitor the size of the packages and their dependencies
  2. Use https://npmgraph.js.org to identify and monitor the packages' dependency graph
  3. Use ESBuild's metafiles that are produced when building all the packages, to identify and monitor the packages' internal structure and bundled dependencies.

We can take @storybook/core as an example:

  1. https://pkg-size.dev/@storybook/core@8.3.0-beta.4 shows that there are two major esbuild dependencies significantly contributing to the size. Can we replace it? See #29082
  2. https://npmgraph.js.org/?q=@storybook/core@8.3.0-beta.4#select=exact%3Aexpress%404.20.0 shows that express (among others) contribute to a big part of the dependency graph. Can we replace it? See #29083
  3. ESBuild's metafiles for @storybook/core (not currently public) shows that Prettier makes up a big part of the bundled output. Can we replace it, or remove it? See #29084

šŸš© Milestones

šŸ“ˆ Baselines and Bechmarks

See spreadsheet detailing all the packages.

### Tasks
- [ ] https://github.com/storybookjs/storybook/issues/29099
- [ ] https://github.com/storybookjs/storybook/issues/29100

šŸ”§ Optimisations

This section includes all the actual package optimisations that we want to make. The list is highly dynamic and should change a lot during the project.

### Existing work that needs triage
- [ ] #28981
- [ ] #28663

šŸ“¦ Core Packages

### Package replacements
- [ ] Identify potential optimisations
- [ ] https://github.com/storybookjs/storybook/issues/29082
- [ ] https://github.com/storybookjs/storybook/issues/29083
- [ ] #28262
- [ ] #28315
- [ ] #28611
- [ ] https://github.com/storybookjs/storybook/issues/29143
- [ ] https://github.com/storybookjs/storybook/issues/29167
- [ ] https://github.com/storybookjs/storybook/issues/29103
- [ ] https://github.com/storybookjs/storybook/issues/29104
- [ ] https://github.com/storybookjs/storybook/pull/29126
- [ ] https://github.com/storybookjs/storybook/issues/29161
- [ ] https://github.com/storybookjs/storybook/issues/29168
- [ ] yarn libzip
### Architectural changes
- [ ] https://github.com/storybookjs/storybook/issues/29084
- [ ] Enable deduplication/splitting when bundling ESM with ESBuild
- [ ] Re-establish CJS auto-deduplication with esbuild using [cjs-splitting.ts from tsup](https://github.com/egoist/tsup/blob/796fc5030f68f929fecde7c94732e9a586ba7508/src/plugins/cjs-splitting.ts)
- [ ] https://github.com/storybookjs/storybook/issues/29164
- [ ] https://github.com/storybookjs/storybook/issues/29166

šŸ§© Integration Packages

Builders

```[tasklist] ### `@storybook/builder-vite` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/builder-webpack5` - [ ] Identify potential optimisations ```

Renderers

```[tasklist] ### `@storybook/react` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/vue3` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/web-components` - [ ] Identify potential optimisations ```

Frameworks

```[tasklist] ### `@storybook/react-vite` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/react-webpack5` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/nextjs` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/experimental-nextjs-vite` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/angular` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/vue3-vite` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/vue3-webpack5` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/sveltekit` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/svelte-vite` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/web-components-vite` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/web-components-webpack5` - [ ] Identify potential optimisations ```

Addons

```[tasklist] ### `@storybook/addon-docs` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/blocks` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-interactions` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-actions` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/test` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-controls` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-measure` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-outline` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-backgrounds` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-toolbars` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-viewport` - [ ] Identify potential optimisations ``` ```[tasklist] ### `@storybook/addon-onboarding` - [ ] Identify potential optimisations ```

šŸ› ļø Supporting Tooling

Ideally we'd want to set up some tooling that allows to easily inspect package and dependency sizes, to make it easier to optimise these areas. It's still TBD what shape or form these could take.

### šŸŒŸ Essential tooling
- [ ] https://github.com/storybookjs/storybook/issues/29105
- [ ] Improve readability and usefulness of existing sandbox benchmark reports on PRs
- [ ] Reduce the friction of inspecting packages' build outputs
- [ ] Reduce the friction of inspecting packages' complete install size, including dependencies' sizes
- [ ] Create a system that warns when a PR is significantly increasing the size/dependency count
### āœØ Nice-to-have tooling
- [ ] Add [`eslint-plugin-depend`](https://github.com/es-tooling/eslint-plugin-depend) to check all packages' dependencies
- [ ] Reduce the friction of inspecting packages' dependency graph
- [ ] https://github.com/storybookjs/storybook/issues/29106

Related: https://github.com/evanw/esbuild/issues/3909

šŸ¤· Misc

### šŸŽ Wrap up
- [ ] Create a new tracking issue containing the known optimisations we didn't had time to do in this project
- [ ] Compile a list of optimisations we want to do for 9.0 šŸ‘‡
- [ ] Publish a blog post about the reduced footprint
### šŸ’„ Breaking optimisations
- [ ] https://github.com/storybookjs/storybook/issues/29159
- [ ] https://github.com/storybookjs/storybook/issues/29160
### šŸ’– Nice-to-haves
- [ ] Investigate the impact on running `storybook dev` at the end of `storybook init`
- [ ] https://github.com/storybookjs/storybook/issues/29073
JReinhold commented 1 week ago

Based on the baseline calculations, I think it's fair to skip the following packages along with @storybook/addon-essentials for now, because they are "tiny" compared to the rest of the packages here:

image