jghfmanager

HuggingFace EndPoint Manager - Ex. Boot a ChatMusician Endpoint, send some requests then suspend it.

Prototype

1. Inferencer booting and executing the HuggingFace Endpoint described in the 'orpheus-config.yml'

Install and run

pip install -U jghfmanager orpheuspypractice

#run 
cd mycreation_folder

ohfi

Config

orpheus-config.yml

• in current folder or in your home folder

huggingface:
  name: chatmusician-myendpointname
  namespace: myusername
  repository: m-a-p/ChatMusician
  token_env_var: HUGGINGFACE_API_KEY

Musical Inference request

musical.yml

• in current folder where is your creation.
• You can try a bot to help build your prompt (that you will need to convert into YAML): Poe/jgwill/cmPengHelperAlpha
• For the more advanced user, you can view an engineered prompt in langsmith hub jgwill/cmpenghelperbeta

  musical:
  name: mycreationname
  sname: iterationname
  prompts:
  prompt1: "the prompt text...."
  prompt2: "another prompt or a variation...."

Python use for LangSmith Hub Prompt jgwill/cmpenghelperbeta

install

pip install -U langchainhub

from langchain import hub
tool_hub_tag="jgwill/cmpenghelperbeta"
prompt_template = hub.pull(tool_hub_tag)