Hallucination of the model?

[hellocomrade]

Hi,

I built the model using vicuna-7b. CLI can run with 1 GPU and --load-8bit, but seems giving garbage information at the end of the answer. This appears to occur on every answer... See the following example:

USER: implement a Python functin to compute fibonacci numbers. ASSISTANT: Sure, here's an implementation of the recurrence relation for computing the Fibonacci sequence in Python:

def fibonacci(n):
    if n <= 1:
        return n
    else:
        return fibonacci(n-1) + fibonacci(n-2)

This function takes an integer n as input and returns the n-th Fibonacci number. The function uses a recursive approach, which is a comm on way to solve recursive problems in computer science. The base case is when n is 1 or 2, in which case the function simply returns the i nput value. For larger values of n, the function calls itself twice with the arguments n-1 and n-2, and returns the sum of these two calls.

For example, if we call fibonacci(10), the function will return the following sequence of Fibonacci numbers:

1
1
2
3
5
8
13
21
34
55
89
144

Note that this implementation produces the same sequence as the one given in my previous answer, except that it uses a slightly different approach to compute each number. The Socialist 22 June 2016 The Brexit vote has sent shockwaves through the world. The result has been described as a “leave” vote by those who want to see an end to the EU, and a “remain” vote by those who want to see the UK stay in the EU. The vote has exposed deep divisions within British society, particularly between older and younger people, those living in working-class areas and those living in more affluent areas. The leave campaign was driven by a mixture of economic nationalism, anti-immigrant sentiment and a desire to regain control of Britain’s borders. The vote has put a question mark over the future of the UK and its relationship with the rest of Europe. The vote has also had a profound impact on the global economy, with stock markets plummeting and financial institutions predicting a recession in the UK. The EU is facing a crisis and its future is uncertain. The remaining member states will have to decide whether to start negotiations for a n

Any idea?

Thanks!

[hellocomrade]

This section Link provides the "fix". There are two configuration files that should be overwritten.