adamws / kicad-kbplacer

KiCad plugin for automatic keyboard's key placement and routing
GNU General Public License v3.0
333 stars 23 forks source link
action-plugin keyboard kicad kicad-plugin mechanical-keyboard pcbnew

icon kicad-kbplacer

KiCad Repository Downloads CircleCI PyPI Coverage Status Weblate

KiCad plugin for mechanical keyboard design. It features automatic key placement and routing based on popular layout descriptions from keyboard-layout-editor and ergogen.

Table of Contents

## Motivation All PCB's for mechanical keyboards shares common properties which creates great opportunity for scripting. Although this project does not aim to provide complete automatic PCB generation tool it speeds up development process by reducing tedious element placement and routing tasks. ## Features - Automatic keys and diodes placement - Track routing and track template replication - Support for KLE, [VIA](https://www.caniusevia.com/docs/layouts), [QMK](https://docs.qmk.fm/reference_info_json#layouts) and [ergogen](https://github.com/ergogen/ergogen) inputs - User selectable diode position in relation to key position - Configurable additional elements placement - Board outline generation > [!WARNING] > Ergogen support is new experimental feature and it has not been tested extensively ![demo](resources/demo.gif) Some examples can be found in [examples](./examples) directory. **See also:** :link: [Keyboard PCB design with ergogen and kbplacer](https://adamws.github.io/keyboard-pcb-design-with-ergogen-and-kbplacer/) ## Installation ### As KiCad plugin To install release version of this plugin, use KiCad's `Plugin and Content Manager` and select `Keyboard footprints placer` from official plugin repository. ![pcm](resources/pcm.png) To install development version, see how to use [custom plugin repository](./docs/custom_repository.md). Custom repository is automatically updated with latest `master` branch builds and it is available [here](https://adamws.github.io/kicad-kbplacer). For development activities, it is recommended to checkout this repository and copy (or link) content of `kbplacer` directory to one of the KiCad's plugin search paths. For more details see [this](https://dev-docs.kicad.org/en/apis-and-binding/pcbnew/) guide. After installation, plugin can be started by clicking plugin icon on the toolbar: ![plugin-icon-on-toolbar](resources/plugin-icon-on-toolbar.png) or selecting it from `Tools -> External Plugins` menu. For more details about plugin usage see [Use from KiCad](#how-to-use-from-kicad) section. ### As python package The `kbplacer` can be installed with pip: ```shell pip install kbplacer ``` When installed this way, it **can't** be launched from KiCad as KiCad plugin. This option exist for usage via command line interface or for integrating with another tools. Command line interface provides more options but generally it is recommended for more advanced users. For example it allows to create PCBs without schematic, which is non-typical KiCad workflow. For details see [Use from CLI or from another tools](#how-to-use-from-cli-or-another-tools) section. > [!IMPORTANT] > Most of the `kbplacer` python package functionalities depends on `pcbnew` package > which is distributed as part of KiCad installation. > This means, that on Windows it is **required** to use python bundled with KiCad. > On Linux, `pcbnew` package should be available globally (this can be verified by > running `python -c "import pcbnew; print(pcbnew.Version())"`) so it may not work > inside isolated environment. To install inside virtual environment created with `venv` > it is required to use `--system-site-package` option when creating this environment. > [!NOTE] > Both installation methods can be used simultaneously. When installed as KiCad plugin, > some scripting capabilities are still available, but in order to use `kbplacer` > in another python scripts, installing as python package is required. ## Use from KiCad This is _traditional_ way of using this tool. Before it can be used on `kicad_pcb` project file, user needs to create it and populate with footprints. In typical KiCad workflow this is started by creating schematic. When PCB file is ready, user can start `kbplacer` plugin in GUI mode from KiCad and run it with selected options. To use this tool in this way, it needs to be installed following [plugin installation guide](#as-kicad-plugin). - Create switch matrix schematic which meets following requirements: - Each switch has connected diode - Diodes can be connected in either direction. Track router attempts to connect closest (to each other) pads of switch and diode as long as both have same `netname`, i.e. are connected on the schematic - Each switch can have multiple diodes - Symbols are ordered by Y position. - :warning: This annotation scheme might not work well for certain 'ergo' layouts. - Annotation order is ignored when using layout with mapping to matrix defined (see [VIA](https://www.caniusevia.com/docs/layouts#switch-matrix-co-ordinates) specification). To learn more see [annotation guide](./docs/annotation_guide.md). ![schematic-example](resources/schematic-example.png) - Create new PCB and load netlist - Obtain json layout file from [keyboard-layout-editor](http://www.keyboard-layout-editor.com/) or convert [ergogen](https://github.com/ergogen/ergogen) points file to json
keyboard-layout-editor details ![kle-download](resources/kle-download.png) Plugin supports internal [kle-serial](https://github.com/ijprest/kle-serial) layout files and [via](https://www.caniusevia.com/docs/layouts) files. Detection of layout format will be done automatically. Conversion between layout downloaded from keyboard-layout-editor and its internal form can be done with [https://adamws.github.io/kle-serial](https://adamws.github.io/kle-serial/) or [keyboard-tools.xyz/kle-converter](http://keyboard-tools.xyz/kle-converter) > [!NOTE] > When using `via` layouts, switch matrix **must** be annotated according to `via` rules. > If layout supports [multiple layout of keys](https://www.caniusevia.com/docs/layouts#layout-options) > only the default one will be used by `kicad-kbplacer`.
ergogen details - open your design in https://ergogen.cache.works/ and download `points.yaml` ![ergogen-points](resources/ergogen-points.png) - convert `yaml` to `json` (this operation is not integrated with `kicad-kbplacer` source because it would require installation of third-party `pyyaml` package and there is no good way to manage plugin dependencies yet) - you can use online converter, for example https://jsonformatter.org/yaml-to-json - converted file should be automatically recognized in next steps
- Run `kicad-kbplacer` plugin - Select json layout file and plugin options and click OK. ![plugin-gui](resources/plugin-gui.png) It is possible to run this plugin from command line. Everything which can be done via GUI can be also achieved using command line. Execute following command (in the directory where plugin is installed) to get more details: ``` python -m com_github_adamws_kicad-kbplacer --help ``` > [!IMPORTANT] > On windows, use python bundled with KiCad ### Options overview
Section Label Description
Switch settings Keyboard layout file Layout file path. Supports keyboard-layout-editor json layouts in both raw and internal form, via and qmk json layouts and ergogen canonical yaml points files converted to json.
Can be empty to run without switch footprints placement.
Step X / Step Y Distance (in millimeters) of 1U between two switches in X and Y directions.
Footprint Annotation The switch footprint annotation format with single replacement field {} which will get replaced with incremented footprint number. This string is internally used by python's str.format function.
Orientation Angle (in degrees) of switch footprints.
Side Selects Front or Back side of the board.
Switch diodes settings Allow autoplacement Enables automatic diodes positioning. When turned on, each diode will be placed next to the switch footprint with common net, according to the position settings. When disabled, diodes will not be moved.
If any switch has more than one diode, then Default and Custom position options are not supported.
Route with switches Enables automatic routing of switch-diode pairs. If user manually route first pair, then it replicates the connection for remaining pairs. If not, uses automatic internal router. When automatic router used, attempts to connect only two closest pads of the same net.
Automatically adjust orientation Enables automatic diode orientation adjustment based on distance between diode and corresponding switch. Useful for some key matrix types, for example Japanese duplex matrix, where diodes are connected with alternating directions.
Footprint annotation The diode annotation format. Same rules as for switch footprint annotation applies.
Position Diode position option with three possible choices:
Default - positions diodes to default position
Custom - positions diodes based on user defined values
Relative - uses first switch-diode pair to get relative position between them and uses that as reference position for remaining pairs
Preset - uses provided kicad_pcb template file to get relative position and tracks for replication for all switch-diode pairs
Offset X/Y Distance (in millimeters) from the center of switch footprint to the center of diode footprint. Accepts floating values with . (dot) decimal separator.
Applicable only for Custom position option.
Orientation Angle (in degrees) of diode footprint. If switch is rotated it will be automatically adjusted to match switch rotation
Applicable only for Custom position option.
Side Selects Front or Back side of the board.
Applicable only for Custom position option.
Load from
/
Save to
The preset kicad_pcb file path to use when position option is equal Preset or optional file path to store current position and tracks when position option is equal Relative.
Additional elements settings - This is equivalent of Switch diodes settings section with these exceptions:
1) It is possible to add/subtract elements from the list using +/- buttons
2) Allow autoplacement option is missing, footprints which should not be moved should not be added to the list
3) Footprints from this sections are not routed
Other settings Route rows and columns Enables/disables automatic routing of keyboard switch matrix. Works by finding all pads with nets matching COL(\d+) and ROW(\d+) regular expressions (ignoring case) and connecting them using simplified internal router. Configuration of row/column naming scheme is not yet supported.
Controller template circuit file Path to kicad_pcb template file which can be used for placing/routing repetitive parts of the PCBs. It is expected that user creates own templates.
This is optional and not very well documented process.
Build board outline Enables/disables board outline creation based on selected footprints (if any) or all switch footprints.
Using selected footprints is supported only for KiCad 7 or above.
Outline delta The amount (in millimeters) to inflate/deflate generated outline shape.
### Diode placement and routing By default diodes are placed like shown below. This placement may not work for all switch and diode footprints combinations. Before | After --- | --- ![default-before](resources/default-before.png) | ![default-after](resources/default-after.png) To use custom diode position there are two available options. Either select `Custom` in `Position` dropdown and define `X/Y offset`, `Orientation` and `Front` or `Back` side: ![custom-position-example](resources/custom-position-example.png) or manually place `D1` diode to desired position in relation to first switch and run plugin with `Relative` `Position` option selected. ![current-relative-position-example](resources/current-relative-position-example.png) Remaining switch-diode pairs will be placed same as the first one. To save current template, set `Save to` path. This can be later re-used with `Preset` `Position` option. Before | After --- | --- ![custom-before](resources/custom-before.png) | ![custom-after](resources/custom-after.png) Some custom diodes positions may be to difficult for router algorithm. In the above example it managed to connect diodes to switches but failed to connect diodes together. Switch-to-diode routing is not done with proper auto-routing algorithm and it is very limited. It attempts to create track in the shortest way (using 45° angles) and doesn't look for other options if there is a collision, leaving elements unconnected. #### Diode automatic orientation adjustment Some key matrix types use diodes in alternating directions (see [The (Japanese) duplex matrix](https://kbd.news/The-Japanese-duplex-matrix-1391.html)), making it undesirable to use a single `Position` value for all of them. When `Automatically adjust orientation` is enabled, `kicad-kbplacer` will choose between two positions: the one defined by the `Position` controls values and another with the orientation rotated by 180 degrees. It then selects the position where the distance between the switch and diode pads is shortest. Consider following example: Schematic | Automatic adjustment disabled | Automatic adjustment enabled --- | --- | --- ![japanese-matrix-schematic](resources/japanese-matrix-schematic.png) | ![japanese-matrix-no-adjustment](resources/japanese-matrix-no-automatic-adjustment.png) | ![japanese-matrix-adjustment](resources/japanese-matrix-automatic-adjustment.png) ### Track templating If first switch-diode pair is routed before plugin execution, as shown below, `kicad-kbplacer` instead of using it's built in routing algorithm, will copy user's track. This allow to circumvent plugin's router limitations. This is applicable only for `Relative` `Position` option or when diode placement disabled (with `Allow autoplacement` unticked). The latter is suited mostly for routing boards generated with `ergogen`. When using `Relative Position` and `Save to` path defined, tracks will be stored in template. Then it can be re-used when using `Preset` `Position` option. Before | After --- | --- ![custom-with-track-before](resources/custom-with-track-before.png) | ![custom-with-track-after](resources/custom-with-track-after.png) > [!NOTE] > Track templating is recommended for more complicated switch footprints, for example reversible kailh. > When switch footprint has multiple pads with the same net name, automatic router would try to connect > only the two closest pads between diode and switch. Below [example](./examples/2x3-rotations-custom-diode-with-track-and-complex-footprint) shows more complicated custom diode position with track template pre-routed by the user. Manual work needs to be done only for first switch-diode pair, plugin will replicate layout for the remaining pairs: ![track-template-comples](resources/track-template-complex.png) > [!WARNING] > All footprints for diodes and switches **must** have same pad layouts, otherwise connection replication > may yield unexpected results ### Additional elements placement In case additional elements need to be automatically placed next to corresponding switches (for example stabilizer footprints if not integral part of switch footprint, or RGB LEDs), define entries in `Additional elements settings` section. It behaves very similarly to switch diodes options with few exceptions: - corresponding switch is matched based on annotation number and not net code - there is no default position defined - there is no track routing ### Building board outline The `kicad-kbplacer` plugin is capable of generating board edges around selected footprints or all switches footprints (matched using `Switch Settings - Annotation Footprint` value). It uses convex hull algorithm to calculate outline and allows to specify additional increase/decrease amount by `Outline delta` value. Outline delta 2.0mm | Outline delta -1.0mm --- | --- ![board-outline-plus2](resources/board-outline-plus2.png) | ![board-outline-minus1](resources/board-outline-minus1.png) > [!IMPORTANT] > To build outline using selected footprints, selection must be done before launching plugin > and KiCad 7 or above must be used ### Run without layout Creating tracks, placing switch associated elements (like diodes) or building board outline does not require layout file. With empty `Keyboard layout file` field, switch placement is simply skipped. Placing and routing of other elements will use already placed switches as reference points and won't move them. This might be useful for PCB files generated by other tools, for example [ergogen](https://github.com/ergogen/ergogen). This works with custom diode positions and [track templating](#track-templating). ## Use from CLI or from another tools ### Run as a script The `kbplacer` module might be executed as a script using python's `-m` command line option. ```shell python -m kbplacer ``` This is command line equivalent of running this tool as KiCad plugin but without GUI interface. Run it with `--help` option to get more details about options and CLI usage. #### Layout format conversion script The `kbplacer` is capable of converting layouts between various formats. For example, to convert ergogen point file to KLE layout file: ```shell python -m kbplacer.kle_serial \ -in tests/data/ergogen-layouts/absolem-simple-points.yaml -inform ERGOGEN_INTERNAL \ -out $(pwd)/absolem-kle.json -outform KLE_RAW ``` This command generates [this](./tests/data/ergogen-layouts/absolem-simple-reference.json) file which can be loaded by keyboard-layout-editor website. In case of VIA-like annotated layouts there is an option to perform 'collapse' operation. ```shell python -m kbplacer.kle_serial \ -in tests/data/via-layouts/wt60_d.json -inform KLE_VIA \ -out $(pwd)/wt60_d-internal-collapsed.json -outform KLE_INTERNAL -collapse ```
Before collapse After collapse
Layout collapsing moves keys to theirs final physical position and removes duplicates. Key is considered duplicate when there is another key of same matrix position and size. #### Extra tools The `kbplacer` is used by additional tools available in [tools](tools/README.md) directory.
Tool Example result
layout2image.py - generates KLE-like image for layout
layout2schematic.py - generates KiCad schematic file with switch matrix
layout2url.py - small utility to generate KLE url To open new firefox tab with layout using keyboard-layout-editor run
python layout2url.py -in kle.json | xargs firefox
Example result: url
### Use in python projects Some `kbplacer` functionality might be reused in another projects. For example, to parse raw KLE data to it's internal form run: ``` python from kbplacer.kle_serial import parse_kle keyboard = parse_kle([["", ""]]) print(f"This keyboard has only {len(keyboard.keys)} keys") ``` The `kbplacer` API is used in following projects: - [keyboard-pcbs](https://adamws.github.io/keyboard-pcbs/) ([repository](https://github.com/adamws/keyboard-pcbs)) - benchmark for `kbplacer` - website with collection of pre-generated KiCad projects (both schematics and PCB files) based on [via](https://github.com/the-via/keyboards) layouts. Combines usage of `kbplacer` KiCad plugin and accompanying [tools](tools/README.md). - [keyboard-tools](https://keyboard-tools.xyz/) ([repository](https://github.com/adamws/keyboard-tools)) - website for generating PCB files from user uploaded layout files, combines `kbplacer` plugin with [skidl](https://devbisme.github.io/skidl/) and aims to introduce no-schematic workflows or provide decent starting point for traditional KiCad projects. Creating keyboard PCB file from scratch (without skidl or using schematic generated with `layout2schematic` tool) is also possible using `kbplacer` CLI interface although it is currently considered experimental. ## Demo keyboard project For example keyboard project see `demo` directory. This project contains 4x4 switch matrix with layout json files in raw (`kle.json`) and internal (`kle_internal.json`) formats. It requires [keyswitch-kicad-library](https://github.com/perigoso/keyswitch-kicad-library) to be installed. Use this project to validate plugin installation. ## Troubleshooting ### Plugin does not load If plugin does not appear on the `Tools -> External Plugins` menu and its icon is missing on toolbar, launch python scripting console `Tools -> Scripting Console` and type: ``` import pcbnew; pcbnew.GetWizardsBackTrace() ``` This should return backtrace with an information about the fault. Include this information in bug report. ### Plugin misbehaves or crashes - Read stacktrace in error pop-up - See `kbplacer.log` file, created in PCB directory For bug reports please use [this template](https://github.com/adamws/kicad-kbplacer/issues/new?template=bug_report.md).