Open VovaTch opened 9 months ago
Thank you for your interest in our work.
It is normal to receive this warning. This is because the weights for normalization are stored in the files for each stage's pth.
I don't know what makes the model perform poorly when reasoning, can you please give me specific examples?
For a simple example, I have this image of my cat:
And the prompt is What are the colors of this cat?
I get this messy response:
In addition, I get this message when running the model in my terminal:
Running on local URL: http://127.0.0.1:7860
Could not create share link. Missing file: /home/tcv1tv/anaconda3/envs/tinygptv/lib/python3.9/site-packages/gradio/frpc_linux_amd64_v0.2.
Please check your internet connection. This can happen if your antivirus software blocks the download of this file. You can install manually by following these steps:
1. Download this file: https://cdn-media.huggingface.co/frpc-gradio-0.2/frpc_linux_amd64
2. Rename the downloaded file to: frpc_linux_amd64_v0.2
3. Move the file to this location: /home/tcv1tv/anaconda3/envs/tinygptv/lib/python3.9/site-packages/gradio
/home/tcv1tv/anaconda3/envs/tinygptv/lib/python3.9/site-packages/gradio/helpers.py:818: UserWarning: Using the update method is deprecated. Simply return a new object instead, e.g. `return gr.Textbox(...)` instead of `return gr.update(...)
warnings.warn(
/home/tcv1tv/anaconda3/envs/tinygptv/lib/python3.9/site-packages/gradio/components/image.py:193: UserWarning: Using the update method is deprecated. Simply return a new object instead, e.g. `return gr.Image(...)` instead of `return gr.Image.update(...)`.
warnings.warn(
/home/tcv1tv/anaconda3/envs/tinygptv/lib/python3.9/site-packages/gradio/components/textbox.py:163: UserWarning: Using the update method is deprecated. Simply return a new object instead, e.g. `return gr.Textbox(...)` instead of `return gr.Textbox.update(...)`.
warnings.warn(
/home/tcv1tv/anaconda3/envs/tinygptv/lib/python3.9/site-packages/gradio/components/button.py:89: UserWarning: Using the update method is deprecated. Simply return a new object instead, e.g. `return gr.Button(...)` instead of `return gr.Button.update(...)`.
warnings.warn(
/home/tcv1tv/anaconda3/envs/tinygptv/lib/python3.9/site-packages/transformers/generation/utils.py:1518: UserWarning: You have modified the pretrained model configuration to control generation. This is a deprecated strategy to control generation and will be removed soon, in a future version. Please use and modify the model generation configuration (see https://huggingface.co/docs/transformers/generation_strategies#default-text-generation-configuration )
warnings.warn(
The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
Setting `pad_token_id` to `eos_token_id`:50256 for open-end generation.
It's possible that my corporate firewall blocks me from downloading links from a Python code. Will downloading manually the file in the warning help? Also, there is this comment about setting attention masks and pad tokens... Is this working as expected?
I think it may be that a more explicit instruction is needed to tell him that because the language model is Phi-2 (no instruction learning is done just a base model).
You can ask him for some descriptive statements that he might be better at.
Thanks for your feedback, we will focus on addressing this reason in the next release!
And what about the The attention mask and the pad token id were not set. As a consequence, you may observe unexpected behavior
comment? Is it a training-only comment or am I missing something here?
This is just a normal warning that can be ignored because we defined new terminators in the training, thanks for your question!
Is this normal? Nothing is output; but some pictures can be output?
It seems that the sentence need ‘.’ in the end.
Not only that, he likes to repeat one sentence over and over again.
Hi, I'm trying to run the demo.py script for model stage 3. I've followed your instructions for replacing the
modeling_phi.py
file intransformers/models/
with the one in the repo, downloaded the Phi-2 repo linked, placed all files inweights/phi-2/
folder, and replaced the mentioned path in the 3 files withweights/phi-2/
. I get the following warning, and the model doesn't perform well when running the demo:I'm running a corporate offshoot of Ubuntu 20.04 if it is of any significance.
My minigpt_v2.yaml:
My minigpt4_vicana0.yaml:
My line 16 in conversation.conversation.py:
Maybe it's a planned behavior? If so, please clarify.