OpenGVLab / LLaMA-Adapter

[ICLR 2024] Fine-tuning LLaMA to follow Instructions within 1 Hour and 1.2M Parameters
GNU General Public License v3.0
5.75k stars 374 forks source link

Is it normal to have outputs for example.py that is different from yours? #50

Open yxchng opened 1 year ago

yxchng commented 1 year ago

Below is the my output for example.py using 7B LLaMA and llama_adapter_len10_layer30_release.pth.

> initializing model parallel with size 1
> initializing ddp with size 1
> initializing pipeline with size 1
Loading

Loaded in 130.34 seconds
Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Tell me about alpacas.

### Response:Alpacas are a species of camelid native to South America. They are typically bred for their soft, luxurious fiber, which is used to make clothing, blankets, and other textiles. Alpacas are also raised for their meat and milk. They are generally docile and easy to care for, and can live up to 20 years.

==================================

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Tell me about the president of Mexico in 2019.

### Response:The president of Mexico in 2019 was Andrés Manuel López Obrador, who was elected in 2018. He is a member of the left-wing party MORENA and is known for his anti-corruption stance and his commitment to social justice. He has also been praised for his efforts to improve relations with the United States and Canada.

==================================

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Tell me about the king of France in 2019.

### Response:The king of France in 2019 is Emmanuel Macron, who was elected in 2017. He is the youngest president in the history of France and has been credited with bringing about major reforms in the country. He has also been praised for his efforts to strengthen the European Union and his commitment to fighting climate change.

==================================

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
List all Canadian provinces in alphabetical order.

### Response:Alberta, British Columbia, Manitoba, New Brunswick, Newfoundland and Labrador, Northwest Territories, Nova Scotia, Nunavut, Ontario, Prince Edward Island, Quebec, Saskatchewan, Yukon.

==================================

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Write a Python program that prints the first 10 Fibonacci numbers.

### Response:def fibonacci(n):
    if n == 0:
        return 0
    if n == 1:
        return 1
    return fibonacci(n - 1) + fibonacci(n - 2)

print(fibonacci(10))

==================================

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Write a program that prints the numbers from 1 to 100. But for multiples of three print 'Fizz' instead of the number and for the multiples of five print 'Buzz'. For numbers which are multiples of both three and five print 'FizzBuzz'.

### Response:def print_numbers(start, end):
    for i in range(start, end):
        if i % 3 == 0 and i % 5 == 0:
            print("FizzBuzz")
        elif i % 3 == 0:
            print("Fizz")
        elif i % 5 == 0:
            print("Buzz")
        else:
            print(i)

==================================

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Tell me five words that rhyme with 'shock'.

### Response:Rock, cook, snook, hook, and look.

==================================

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Translate the sentence 'I have no mouth but I must scream' into Spanish.

### Response:No tengo boca pero tengo que gritar.

==================================

Below is an instruction that describes a task. Write a response that appropriately completes the request.

### Instruction:
Count up from 1 to 500.

### Response:1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68, 69, 70, 71, 72, 73, 74, 75, 76, 77, 78, 79, 80, 81, 82, 83, 84, 85, 86, 87, 88, 89, 90, 91, 92, 93, 94, 95, 96, 97, 98, 99, 100, 101, 102, 103, 104, 105, 106, 107, 108, 109, 110, 111, 112, 113, 114, 115,

==================================

It seems different from some of the examples in your README.md. For example, you have


Instruction 4:

Tell me about the president of Mexico in 2019.

    LLaMA-Adapter: The president of Mexico in 2019 was Andrés Manuel López Obrador, who took office on December 1st, 2018. He is a member of the left-wing party Morena and is known for his populist policies. He has focused on tackling corruption, reducing poverty, and improving the country's infrastructure. He has also been a vocal critic of the United States' immigration policies.

which is different from

### Instruction:
Tell me about the president of Mexico in 2019.

### Response:The president of Mexico in 2019 was Andrés Manuel López Obrador, who was elected in 2018. He is a member of the left-wing party MORENA and is known for his anti-corruption stance and his commitment to social justice. He has also been praised for his efforts to improve relations with the United States and Canada.
aojunzz commented 1 year ago

We updated the adapter checkpoint after finetuning code release. your results achieve similar quality of the results in readme.