bklieger-groq / g1

g1: Using Llama-3.1 70b on Groq to create o1-like reasoning chains
MIT License
3.79k stars 342 forks source link

If I change the model to "llama3-70b-8192" in app.py, it show erros #1

Closed diyism closed 1 month ago

diyism commented 1 month ago

I prefer "llama3-70b-8192" than "llama-3.1-70b-versatile", but if I change the model to "llama3-70b-8192" in app.py, it showed erros.

Enter your query: All solar system moons larger than Pluto, with diameter data, arranged from largest to smallest

Step 1: Understanding the Problem The problem asks for a list of all solar system moons larger than Pluto, with diameter data, arranged from largest to smallest. To tackle this, I need to clarify what 'larger than Pluto' means in terms of diameter, and which moons in our solar system meet this criterion.

Step 2: Error Failed to generate step after 3 attempts. Error: Error code: 400 - {'error': {'message': "Failed to generate JSON. Please adjust your prompt. See 'failed_generation' for more details.", 'type': 'invalid_request_error', 'code': 'json_validate_failed', 'failed_generation': ''}}

Final Answer

Failed to generate final answer after 3 attempts. Error: Error code: 400 - {'error': {'message': "Failed to generate JSON. Please adjust your prompt. See 'failed_generation' for more details.", 'type': 'invalid_request_error', 'code': 'json_validate_failed', 'failed_generation': '{"title": "Determining Pluto's Diameter", "content": "To determine which moons are larger than Pluto, I need to know Pluto's diameter. According to NASA, Pluto's diameter is approximately 2,374 kilometers. I will use this value as a threshold to identify larger moons.", "next_action": "continue"}\n\n\n{"title": "Gathering Moon Data", "content": "I will gather data on the diameters of moons in our solar system from a reliable source, such as NASA or the International Astronomical Union (IAU). This will provide a comprehensive list of moon diameters to compare with Pluto's diameter.", "next_action": "continue"}\n\n\n{"title": "Filtering and Ranking Moons", "content": "I will filter the list of moons to only include those with diameters greater than 2,374 kilometers. Then, I will rank the remaining moons in order of largest to smallest based on their diameters.", "next_action": "final_answer"}\n\n\n{"title": "Final Answer", "content": "Here is the list of solar system moons larger than Pluto, with diameter data, arranged from largest to smallest:\n\n1. Ganymede (Jupiter's moon) - diameter: approximately 5,262 kilometers\n2. Titan (Saturn's moon) - diameter: approximately 5,150 kilometers\n3. Callisto (Jupiter's moon) - diameter: approximately 4,821 kilometers\n4. Io (Jupiter's moon) - diameter: approximately 4,266 kilometers\n5. Moon (Earth's moon) - diameter: approximately 3,475 kilometers\n\nNote: The diameters are approximate values and may vary slightly depending on the source.", "next_action": "final_answer"}'}}

Total thinking time: 18.73 seconds

bklieger-groq commented 1 month ago

It looks like the model is having trouble generating valid JSON. I recommend adding more specific instructions or potentially additional examples of valid JSON in the prompt. Llama-3.1-70b-versatile should work well, but for earlier models, more guidance may be useful.

If you make these changes and they work well, feel free to contribute a PR!