Add a utility to detect LLM usage in a config

ludwig-ai / ludwig

Low-code framework for building custom LLMs, neural networks, and other AI models

http://ludwig.ai

Apache License 2.0

11.11k stars 1.19k forks source link

Add a utility to detect LLM usage in a config #3869

Closed jeffkinnison closed 8 months ago

jeffkinnison commented 8 months ago

The LLM encoder in ECD needs to share large parts of the code base with the LLM model type, but branching currently inspects configs for model type only. This adds a utility that detects LLM model type or the usage of LLM encoder in text features for ECD models (LLM encoder is not currently valid for GBM). This can be used as a replacement for expressions like if config.model_type =="llm":.

github-actions[bot] commented 8 months ago

Unit Test Results

  6 files ±0   6 suites ±0 14m 18s :stopwatch: +9s 12 tests ±0   9 :heavy_check_mark: ±0   3 :zzz: ±0 0 :x: ±0 60 runs ±0 42 :heavy_check_mark: ±0 18 :zzz: ±0 0 :x: ±0

Results for commit cb5b01b2. ± Comparison against base commit 6a878bc7.

:recycle: This comment has been updated with latest results.