Pythia Support

[floatingbigcat]

Support neox with following changed:

• add conversation template for neox.
• add preprocess_neox in train.py.
• update builder.py to fix the neox different names for sub module.
• add more config in encoder_info.py

Following demo code should work.

from robin.serve.pipeline import LlavaMistralPipeline
pipe = LlavaMistralPipeline(
    model_path="agi-collective/pythia-410m-deduped-ViT-B-16-finetune-lora",
    model_base="EleutherAI/pythia-410m-deduped",
)

messages = [
{"role": "USER", "content": "What's in the image?", "image": "https://llava-vl.github.io/static/images/view.jpg"},
]
messages = pipe(messages) 
print(messages)