search

flairNLP / fabricator

[EMNLP 2023 Demo] fabricator - annotating and generating datasets with large language models.
Apache License 2.0
99 stars 13 forks source link

Split haystack dependencies #56

Closed whoisjones closed 1 year ago

whoisjones commented 1 year ago

Instead of installing haystack and haystack[inference], we should install the ladder one if required. This is the case if anyone wants to use their own resources for model hosting instead of APIs such as the ones from OpenAI. To do so, we need to adapt the tests and probably implement again the dry_run logic from @HallerPatrick.

HallerPatrick commented 1 year ago

So haystack[inference] is required to load e.g. HF models locally for the node right? With "ladder" on do you mean haystack[inference]?

HallerPatrick commented 1 year ago

I make a PR for the dry_run parameter