issues
search
IAPark
/
tiktoken_ruby
Unofficial ruby binding for tiktoken by way of rust
MIT License
125
stars
26
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Update rb-sys to 0.9.102 for ruby 3.4 compatibility
#39
casperisfine
opened
2 months ago
4
Error loading shared library ld-linux-x86-64.so.2 in Alpine Docker image
#38
fguillen
closed
5 months ago
1
Add support: o200k_base tokenizer.
#37
CaffeeLake
closed
6 months ago
0
Support for new "gpt-4o" tiktoken tokenizer
#36
gtoubassi
closed
6 months ago
2
[untested] Add gpt-4o support (o200k_base)
#35
marckohlbrugge
closed
6 months ago
3
Error installing gem in MacOS M1
#34
AlessandroTolomio
opened
7 months ago
2
Fix cross compile
#33
IAPark
closed
8 months ago
1
Error installing gem on Linux Xenial Ruby 3.0/1 AMD64
#32
MarioRuiz
opened
8 months ago
5
Add a warning that get_encoding is not thread safe
#31
IAPark
closed
8 months ago
0
Fix memoization thread safety
#30
mkdynamic
closed
8 months ago
4
Fix encoding_for_model to return nil for unknown encoding
#29
rob-mindtrip
closed
8 months ago
0
Tiktoken.encoding_for_model has bad return value on unrecognized model name
#28
rob-mindtrip
closed
8 months ago
4
Freezing rb-sys to 0.9.87
#27
ScotterC
closed
9 months ago
0
Request for Maintainers
#26
bmulholland
opened
9 months ago
3
Fix ruby-sys version mismatch between Ruby and Rust
#25
andreaslillebo
closed
9 months ago
0
Version 0.0.7
#24
IAPark
closed
9 months ago
3
Add support for `text-embedding-3`
#23
fredwu
closed
9 months ago
0
Upgrade dependencies including `rb_sys` to 0.9.86 for Ruby 3.3.0 support
#22
dorianmarie
closed
9 months ago
0
Update rbsys to support Ruby 3.3
#21
djrodgerspryor
closed
9 months ago
15
Install failing on Ruby 3.3.0 and Heroku
#20
kapso
closed
9 months ago
14
Enhance extconf.rb for Cross-Platform Compatibility
#19
basicfeatures
closed
8 months ago
1
feat: allow ruby 2.5.9 min
#18
sahilbansal11
closed
1 year ago
0
Support finding encodings for fine-tuned models
#17
spiderbites
closed
9 months ago
0
RBS signatures
#16
drnic
closed
8 months ago
3
[Proposal] Claude Tokenizer
#15
BarberAlec
opened
1 year ago
1
Update magnus for ruby-head compatibility
#14
casperisfine
closed
1 year ago
9
INTERNAL: Update libraries
#13
judy
closed
1 year ago
1
LoadError: /lib/x86_64-linux-gnu/libc.so: invalid ELF header
#12
stephenarifin-payscore
opened
1 year ago
0
Unable to build on OpenBSD
#11
basicfeatures
closed
1 year ago
3
Getting "LoadError" when trying to use the gem as dependency
#10
rolo9128
opened
1 year ago
3
Failed to build on Ventura 13.4.1 M1 and Ruby 2.7.6
#9
teejteej
closed
1 year ago
1
Thread safe?
#8
mkdynamic
closed
8 months ago
7
"Failed to build gem native extension" on Linux (Ubuntu)
#7
bdegomme
opened
1 year ago
0
[Proposal] Add model token limits to tiktoken_ruby
#6
mattlindsey
closed
9 months ago
1
Move `rb_sys` gem dep to gemspec
#5
georgeclaghorn
closed
1 year ago
1
Version 0.0.4
#4
IAPark
closed
1 year ago
0
Fix compiling in ruby 3.0
#3
IAPark
closed
1 year ago
4
Add CI with GitHub Actions
#2
petergoldstein
closed
1 year ago
0
Can't compile on Ruby 3.0: No builder for extension 'ext/tiktoken_ruby/Cargo.toml'
#1
taf2
closed
1 year ago
9