YoadTew / zero-shot-image-to-text

Implementation of Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic
262 stars 42 forks source link

Questions about modifying context cache? #13

Open Kingofolk opened 1 year ago

Kingofolk commented 1 year ago

Hi, thanks for your great work! In the paper, you aim to realize zero-shot caption by modifying the context cache, and in inference, no training is taken place. Could you please explain how to modifying the cache to me? In my thought, the cache is obtained from the prior words (e.g., a image of) which then are passed into the language model. So, how can we modifying the cache without changing the parameters of the model? Looking forward to your reply. Thanks a lot.

Kingofolk commented 12 months ago

Sorry, I have not solved this problem.

Kingofolk commented 12 months ago

是的,铁子

---Original--- From: @.> Date: Thu, Sep 14, 2023 16:36 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

是老铁不?(Is the old iron not?)

在 2023-09-14 16:23:36,"wang zhichuan" @.***> 写道:

Sorry, I have not solved this problem.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

Kingofolk commented 12 months ago

没有呢,我就是读论文然后了解一下。没有用他的方法

---Original--- From: @.> Date: Thu, Sep 14, 2023 19:43 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

兄弟,你有用这个代码,实现图像数据集的caption生成操作吗?

在 2023-09-14 17:21:58,"wang zhichuan" @.***> 写道:

是的,铁子

---Original--- From: @.> Date: Thu, Sep 14, 2023 16:36 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

是老铁不?(Is the old iron not?)

在 2023-09-14 16:23:36,"wang zhichuan" @.***> 写道:

Sorry, I have not solved this problem.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

Kingofolk commented 12 months ago

确实,作者也没有回复。复现的时候可能会踩坑。

---Original--- From: @.> Date: Fri, Sep 15, 2023 15:06 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

他这个方法 我看了一下 作者不理人 里面问题都不回复 无语

---- Replied Message ---- | From | wang @.> | | Date | 09/15/2023 15:05 | | To | YoadTew/zero-shot-image-to-text @.> | | Cc | shams2023 @.>, Comment @.> | | Subject | Re: [YoadTew/zero-shot-image-to-text] Questions about modifying context cache? (Issue #13) |

没有呢,我就是读论文然后了解一下。没有用他的方法

---Original--- From: @.> Date: Thu, Sep 14, 2023 19:43 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

兄弟,你有用这个代码,实现图像数据集的caption生成操作吗?

在 2023-09-14 17:21:58,"wang zhichuan" @.***> 写道:

是的,铁子

---Original--- From: @.> Date: Thu, Sep 14, 2023 16:36 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

是老铁不?(Is the old iron not?)

在 2023-09-14 16:23:36,"wang zhichuan" @.***> 写道:

Sorry, I have not solved this problem.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

Kingofolk commented 12 months ago

这样啊🙈🙈。如果你真的需要这个baseline,就发邮件问问吧。我没有用这个,也帮不了你

---Original--- From: @.> Date: Fri, Sep 15, 2023 15:10 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

踩大坑 我玩了一下 只能一张一张图片生成字幕 想要换成数据集 就死掉

---- Replied Message ---- | From | wang @.> | | Date | 09/15/2023 15:08 | | To | YoadTew/zero-shot-image-to-text @.> | | Cc | shams2023 @.>, Comment @.> | | Subject | Re: [YoadTew/zero-shot-image-to-text] Questions about modifying context cache? (Issue #13) |

确实,作者也没有回复。复现的时候可能会踩坑。

---Original--- From: @.> Date: Fri, Sep 15, 2023 15:06 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

他这个方法 我看了一下 作者不理人 里面问题都不回复 无语

---- Replied Message ---- | From | wang @.> | | Date | 09/15/2023 15:05 | | To | YoadTew/zero-shot-image-to-text @.> | | Cc | shams2023 @.>, Comment @.> | | Subject | Re: [YoadTew/zero-shot-image-to-text] Questions about modifying context cache? (Issue #13) |

没有呢,我就是读论文然后了解一下。没有用他的方法

---Original--- From: @.> Date: Thu, Sep 14, 2023 19:43 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

兄弟,你有用这个代码,实现图像数据集的caption生成操作吗?

在 2023-09-14 17:21:58,"wang zhichuan" @.***> 写道:

是的,铁子

---Original--- From: @.> Date: Thu, Sep 14, 2023 16:36 PM To: @.>; Cc: "wang @.**@.>; Subject: Re: [YoadTew/zero-shot-image-to-text] Questions about modifyingcontext cache? (Issue #13)

是老铁不?(Is the old iron not?)

在 2023-09-14 16:23:36,"wang zhichuan" @.***> 写道:

Sorry, I have not solved this problem.

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>

— Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you commented.Message ID: @.> — Reply to this email directly, view it on GitHub, or unsubscribe. You are receiving this because you authored the thread.Message ID: @.>