Split text into semantic chunks, up to a desired chunk size. Supports calculating length by characters and tokens, and is callable from Rust and Python.
MIT License
259
stars
16
forks
source link
Bump the minor group in /docs with 26 updates #246
#1130844c61dd Thanks @ematipico! - Fixes an issue where custom 404.astro and 500.astro were not returning the correct status code when rendered inside a rewriting cycle.
#113020622567 Thanks @martrapp! - Fixes an issue with the view transition router when redirecting to an URL with different origin.
#1130844c61dd Thanks @ematipico! - Fixes an issue where custom 404.astro and 500.astro were not returning the correct status code when rendered inside a rewriting cycle.
#113020622567 Thanks @martrapp! - Fixes an issue with the view transition router when redirecting to an URL with different origin.
54baf82 Add types, remove position, use, useFirstfeature: add types
breaking: remove position field (use unist-util-remove-position if you previously set position: false)
breaking: remove support for use, useFirst (manipulate the lists of plugins yourself)
patch: fix support for CR, CRLF line endings
cd152e7 Update @types/unistmigrate: update @types/unist too
8a2febe Change to require Node.js 16
migrate: update Node
f91a1c2 Change to use export map
migrate: don’t use private APIs
dc59467 Change types to work w/o explicit type parameter
migrate: don’t pass an explicit type parameter;
replace AssertAnything, AssertPredicate -> Check;
TestFunctionAnything, TestFunctionPredicate -> TestFunction;
PredicateTest -> Test
3faad68 Change to require Node.js 16
migrate: update Node
f8ab16b Change to use export map
migrate: don’t use private APIs
357e056 Remove position field, add support for options
by @wooorm in vfile/vfile-message#19migrate: if you used .position, switch that to .place
optionally use the nicer options parameter to pass your things
46dd635 Change to require Node.js 16
migrate: update Node
f72469b Change to use export map
migrate: don’t use private APIs
f4edd0d Change to replace Buffer with Uint8Arraymigrate: this will mostly work, but might break if you use weird ancient encodings
by @wooorm in vfile/vfile#85
af5eada Update vfile-messagemigrate: if you used .position on messages, switch that to .place
optionally use the nicer options parameter to pass your things
Bumps the minor group in /docs with 26 updates:
4.11.0
4.11.1
2.8.0
2.8.1
0.4.0
0.4.1
3.1.1
3.1.2
1.9.0
1.9.1
1.0.4
2.0.3
1.4.810
1.4.811
3.1.1
4.0.0
5.0.1
7.0.0
2.1.0
3.0.1
3.1.0
4.0.0
5.2.0
6.1.0
3.1.0
4.0.0
8.1.0
9.0.0
1.9.0
1.9.1
10.1.2
11.0.5
5.2.1
6.0.0
3.1.1
4.0.0
3.0.3
4.0.0
2.0.2
3.0.0
5.1.3
6.0.1
4.1.2
5.0.0
3.1.4
4.0.2
5.3.7
6.0.1
6.2.14
6.3.0
5.2.0
5.3.0
Updates
astro
from 4.11.0 to 4.11.1Release notes
Sourced from astro's releases.
Changelog
Sourced from astro's changelog.
Commits
ce310f8
[ci] release (#11297)47e78d4
fix(deps): update all non-major dependencies (#11318)7c59f04
[ci] format44c61dd
fix(routing): return correct status code for500.astro
and404.astro
(#11...ae3b096
[ci] formatb6afe6a
Handle encoded image paths in markdown (#11310)89b46b8
refactor(plugin-analyzer): code refactor (#11307)04121f4
[ci] format0622567
Fall back to page reload when redirected to a cross origin URL (#11302)e67d7e6
[ci] formatUpdates
@astrojs/compiler
from 2.8.0 to 2.8.1Release notes
Sourced from
@astrojs/compiler
's releases.Commits
7fcc29b
[ci] release (#1013)0bb2746
Allow data-astro-reload to take a value (#1012)ead5809
docs: explain snapshot testing (#1010)4e7cc82
feat: snapshot testing (1/*) (#995)Updates
@astrojs/internal-helpers
from 0.4.0 to 0.4.1Release notes
Sourced from
@astrojs/internal-helpers
's releases.Changelog
Sourced from
@astrojs/internal-helpers
's changelog.Commits
ce310f8
[ci] release (#11297)41064ce
chore: Extract fs helpers into shared internal-helpers package (#11323)Updates
@astrojs/mdx
from 3.1.1 to 3.1.2Release notes
Sourced from
@astrojs/mdx
's releases.Changelog
Sourced from
@astrojs/mdx
's changelog.Commits
ce310f8
[ci] release (#11297)47e78d4
fix(deps): update all non-major dependencies (#11318)Updates
@shikijs/core
from 1.9.0 to 1.9.1Release notes
Sourced from
@shikijs/core
's releases.Commits
603713d
chore: release v1.9.1Updates
@types/nlcst
from 1.0.4 to 2.0.3Commits
Updates
electron-to-chromium
from 1.4.810 to 1.4.811Commits
75fc253
1.4.811eda794a
generate new versionUpdates
nlcst-to-string
from 3.1.1 to 4.0.0Release notes
Sourced from nlcst-to-string's releases.
Commits
482df87
4.0.0e4b95c3
Change to require Node.js 160f4c52c
Change to useexports
c76dbe1
Refactor docsb1ba622
Removeseparator
a20f14d
Refactor code-stylee17b205
Refactor.npmrc
4b04902
Refactorpackage.json
,tsconfig.json
a3ff3fc
Update@types/nlcst
1fffb36
Update dev-dependenciesUpdates
parse-latin
from 5.0.1 to 7.0.0Release notes
Sourced from parse-latin's releases.
Commits
35dc155
7.0.0ad2d932
Change to require Node.js 166ce04d2
Change to useexports
1d96ee6
Change to useundefined
fordoc
field9ae023e
Refactor docsba7f0aa
Refactor code-style864f533
Refactor.npmrc
9b4a3d4
Refactorpackage.json
,tsconfig.json
8fe6893
Update@types/nlcst
,@types/unist
, utilitiesbbd4e8a
Update dev-dependenciesUpdates
remark-smartypants
from 2.1.0 to 3.0.1Release notes
Sourced from remark-smartypants's releases.
Commits
94e4aa2
3.0.19e74e9d
Merge pull request #85 from bluwy/tsbuildinfo-away6e62cd8
Removetsconfig.build.tsbuildinfo
from publish45a6a35
We don't use test globalsb6fabb4
3.0.0162c8ff
Migrate source code to TypeScriptb3b601e
Use Lefthook for git hooks and taskscb568fb
Bump dependenciesd283337
Merge branch 'update-types'1af1923
Merge pull request #83 from silvenon/dependabot/npm_and_yarn/vite-5.2.8Updates
retext-latin
from 3.1.0 to 4.0.0Release notes
Sourced from retext-latin's releases.
Commits
Updates
retext-smartypants
from 5.2.0 to 6.1.0Release notes
Sourced from retext-smartypants's releases.
Commits
070853f
6.1.0e482066
Update dev-dependencies6fa9e37
Add expanded ellipses optionsbc33ba5
6.0.01f0d960
Change to useexports
d79c475
Change to require Node.js 16912a3e7
Refactor docs075143c
Refactor code-style23e7723
Refactor to usenode:test
d72542c
Refactor to move implementation tolib/
Updates
retext-stringify
from 3.1.0 to 4.0.0Release notes
Sourced from retext-stringify's releases.
Commits
Updates
retext
from 8.1.0 to 9.0.0Commits
cd8ad93
9.0.00ceda98
retext-stringify: 4.0.02ce29e8
retext-latin: 4.0.027ae32b
retext-english: 5.0.0fe52462
retext-dutch: 5.0.0252453a
Change to require Node.js 16e719bf4
Change to useexports
d1175c0
Refactor docsf586af3
Refactor code-style67cef52
Remove parser exportsUpdates
shiki
from 1.9.0 to 1.9.1Release notes
Sourced from shiki's releases.
Commits
603713d
chore: release v1.9.173404aa
chore: update depsUpdates
unified
from 10.1.2 to 11.0.5Release notes
Sourced from unified's releases.
... (truncated)
Commits
242105b
11.0.5e1b5162
Refactor code-style1e0863a
Fix exception on older browsers69202f9
Update dev-dependencies303d2d5
Remove emoji from JSDoc to prevent segfault75d8716
Add canary workflow back510fe9e
Update dev-dependenciesfe6f00d
Fix buildb69689b
11.0.41ca1a43
Add TypeScript declaration mapsUpdates
unist-util-is
from 5.2.1 to 6.0.0Release notes
Sourced from unist-util-is's releases.
Commits
9d78618
6.0.0cd152e7
Update@types/unist
8a2febe
Change to require Node.js 16f91a1c2
Change to useexport
map9c291ca
Refactor docsdc59467
Change types to work w/o explicit type parametercf2dacf
Refactor.npmrc
e30e445
Refactorpackage.json
,tsconfig.json
122f5ff
Update dev-dependenciesUpdates
unist-util-modify-children
from 3.1.1 to 4.0.0Release notes
Sourced from unist-util-modify-children's releases.
Commits
a206c61
4.0.0d8fae1c
Update@types/unist
2e92449
Change to require Node.js 165bec8ab
Change to useexport
mapd8a4295
Refactor docs9176f82
Refactor code-styleb5a7425
Refactor.npmrc
8c87f7d
Refactorpackage.json
,tsconfig.json
fb48836
Update dev-dependenciesUpdates
unist-util-stringify-position
from 3.0.3 to 4.0.0Release notes
Sourced from unist-util-stringify-position's releases.
Commits
be90841
4.0.06f1e0f0
Update@types/unist
d6f7251
Change to require Node.js 16dc23794
Change to useexport
mapd762107
Refactor docs9e165c3
Refactor.npmrc
e85618b
Refactor code-style67038e3
Refactorpackage.json
,tsconfig.json
c376ee3
Update dev-dependenciesUpdates
unist-util-visit-children
from 2.0.2 to 3.0.0Release notes
Sourced from unist-util-visit-children's releases.
Commits
bb9d2ac
3.0.0e3f568b
Update dev-dependencies5c95b54
Fix xo8a28747
Change to useexport
map707e7bc
Change to require Node.js 1678c912e
Refactor docs8a545f1
Refactor code-style6e96796
Refactor.npmrc
bd1309e
Refactorpackage.json
,tsconfig.json
3db0a92
Update dev-dependenciesUpdates
unist-util-visit-parents
from 5.1.3 to 6.0.1Release notes
Sourced from unist-util-visit-parents's releases.
Commits
58e20d8
6.0.148f0dc0
Fix TSC generating broken.d.ts
filesd8e1388
6.0.004a70a3
Update@types/unist
8beaeb8
Change to require Node.js 16002ffa4
Change to useexport
mapc5a927c
Refactor docs433b009
Removexo
rulesadf39ed
Add support for inferring type of parents323984d
Change to removecomplex-types.d.ts
Updates
unist-util-visit
from 4.1.2 to 5.0.0Release notes
Sourced from unist-util-visit's releases.
Commits
bc59f3b
5.0.04dcff31
Update@types/unist
befc0b3
Change to require Node.js 16b5f36de
Change to useexport
map77d6cb1
Removexo
rules89fc050
Change to removecomplex-types.d.ts
3cb2732
Fix performance ofInclusiveDescendant
type12c9ee9
Change to passundefined
, notnull
07a2fbe
Refactor docs57992a3
Refactor code-styleUpdates
vfile-message
from 3.1.4 to 4.0.2Release notes
Sourced from vfile-message's releases.
Commits
69c314c
4.0.2b74ef73
Update@types/unist
d5c125f
Refactor to reorder some fieldsf95fb19
Update dev-dependencies29f6f78
4.0.1547bd6d
Fix missingfiles
446a5c6
4.0.03faad68
Change to require Node.js 16f8ab16b
Change to use export map35beb54
Refactor docsUpdates
vfile
from 5.3.7 to 6.0.1Release notes
Sourced from vfile's releases.
Commits
f068642
6.0.1f9f3c8f
Update@types/unist
f5acb71
Updatelib
intsconfig.json
d48461e
Refactor to reorder some fields86677e2
6.0.046dd635
Change to require Node.js 16f4edd0d
Change to replaceBuffer
withUint8Array
f72469b
Change to use export map5e49b06
Fix typo47eec44
Refactor to match current Node internalsUpdates
vscode-css-languageservice
from 6.2.14 to 6.3.0Release notes
Sourced from vscode-css-languageservice's releases.
Changelog
Sourced from vscode-css-languageservice's changelog.