ludwig-ai / ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models
http://ludwig.ai
Apache License 2.0
11.2k stars 1.19k forks source link

WIP: Remove torchtext dependency #4038

Closed mhabedank closed 3 days ago

mhabedank commented 4 weeks ago

torchtext is deprecated but used for some tokenizers in Ludwig. This PR will remove the dependency.

Related to

4031

4032

4033

4034

4035

github-actions[bot] commented 3 weeks ago

Unit Test Results

0 tests   0 :heavy_check_mark:  0s :stopwatch: 0 suites  0 :zzz: 0 files    0 :x:

Results for commit 3c02ae48.

:recycle: This comment has been updated with latest results.

mhabedank commented 3 days ago

this is merged into #4041