search

GoogleCloudPlatform / dfcx-scrapi

A high level scripting API for bot builders, developers, and maintainers.
Apache License 2.0
88 stars 58 forks source link

[BUG] <Utterance Generation Huggingface model file does not appear to load> #129

Open cgibson6279 opened 1 year ago

cgibson6279 commented 1 year ago

Issue Summary

The current Huggingface utterance generation model appears to produce and error when loading file. Had also talk about moving to Google internal model, so now is a good time.

Expected Behavior

Huggingface model should load during call for utterance generation tool for agents.

Current Behavior

FileNotFound Error generated when trying to load model to utterance_generator class.

Possible Solution

Replace current Huggingface model with Google internal pretrained LLM via Vertex AI API.

Context (Environment)

Easy training phrase generation for intent creation not possible at present. Necessary for scaling up CCAI project quickly and efficiently.

cgibson6279 commented 1 year ago

@kmaphoenix we talked about this a while back, but would we want to redo this entirely to use genAI from prompts (e.g. text-bison) or do we still want like a T5 model that just does paraphrases?

kmaphoenix commented 1 year ago

@cgibson6279 Most definitely incorporate the new VertexAI models here. I was waiting for them to go GA before starting any development on that, but now is a great time to start.

There are several areas we can incorporate the GenAI stuff to bolster features/tools we already have in scrapi. Feel free to take a shot and submit a PR when ready.