Implement tokenization from built-in grammars - Githubissues

vsce-toolroom / vscode-textmate-languageservice

Language APIs and support features from Textmate tokenization in Visual Studio Code.

Other

13 stars 0 forks source link

Implement tokenization from built-in grammars #39

Closed zm-cttae closed 1 year ago

zm-cttae commented 1 year ago

🏗️ Pull Request

Description

Add support for tokenization and symbol data generation from built-in grammars.

Checklist

[x] Used a clear / meaningful title for this pull request.
[x] Tested the changes on your own grammar (on your projects).
[x] Added / Edited tests to reflect changes (test folder).
[x] Have read the Contributing part of the README.
[x] Passed npm test.
[x] I noted my changes in the pull request body and/or changelog.

👷🏾‍♀️ Fixes

Part of #22 epic.

What changes have you made?

[x] Implement static extension contribution registry that can fallback to vscode.extensions.all.
[x] Add Textmate grammar resolver methods to map contributions to their source extensions.
[x] Implement wiring for built-in grammar loading in TextmateLanguageService main API constructor.
[x] Rewire test suite to support parameterised targeting of multiple languages.
[x] Refactor test TypeScript extension to load built-in grammar for testing of this PR.
[x] Add new test extension for testing of arbitrary Textmate grammar file.

What tests have you completed?

[x] Tested this in Visual Studio Code v1.79.0.
[x] Tested this in Visual Studio Code Insiders v1.80.0.
[x] Tested this for GitHub Codespaces v1.80.0.
[x] Tested this in VSCodium v1.79.0.

Anything else worth mentioning?