search

randaller / llama-chat

Chat with Meta's LLaMA models at home made easy
GNU General Public License v3.0
833 stars 118 forks source link

I got no print out of AI repsonse #1

Closed lucasjinreal closed 1 year ago

lucasjinreal commented 1 year ago

Only User: outputs

randaller commented 1 year ago

Wow you're so fast :) Did you do all the steps in readme correct? I was still updating the repo, now it is in 100% working state.

lucasjinreal commented 1 year ago

@randaller roughly looked at the logic, there is no print after generator return. So result actually wont print on screen after responsed.

lucasjinreal commented 1 year ago

@randaller It's not work

图片
randaller commented 1 year ago

there is no print after generator return. So result actually wont print on screen after responsed.

that's because generator prints result itself

@randaller It's not work

图片

That's not a code from this repo. No parallelism or so enabled in this repo. Clone this repo and pass all the readme steps, I have tested and everything is working.