instructlab / instructlab-bot

GitHub bot to assist with the taxonomy contribution workflow
Apache License 2.0
12 stars 15 forks source link

SDG throwing a 500 on tax PR 1148 #384

Closed nerdalert closed 2 weeks ago

nerdalert commented 1 month ago

The PR https://github.com/instructlab/taxonomy/pull/1148 is throwing a 500 from SDG. Raised the issue with Raymond and it's being tshot on the server side. cc/ @jjasghar

cmd/generate.go:683 Failed to generate data: unexpected status code 500: {"error":"[Errno 2] No such file or directory: '/tmp/new_data/sdg_pipeline_test/e2eac873-525c-499f-aae0-f32553bd5073/_e2eac873-525c-499f-aae0-f32553bd5073__messages.jsonl'"

The full post:

{POST https://datagen-service-predictor-fmaas-rhods-testing.apps.fmaas-devstage-backend.fmaas.res.ibm.com/knowledge/datagen HTTP/1.1 1 1 map[Accept:[application/json] Content-Type:[application/json]] {{"created_by":"sumanair","document":{"commit":"11dc36a4948416e42394562d0d8bcea2b13b421b","patterns":["NobelLaureates/India/List_of_Indian_Nobel_laureates.md"],"repo":"https://github.com/sumanair/instructlab_knowledge.git"},"domain":"indian nobel laureates","mm_model_id":"mistralai/mixtral-8x7b-instruct-v0-1","num_samples":10,"seed_examples":[{"answer":"Rabindranath Tagore, a renowned Indian poet, was the first Indian  to win the Nobel Prize for Literature in 1913.\n","question":"who was the first Indian Nobel laureate?"},{"answer":"Mohandas Karamchand Gandhi (Mahatma Gandhi) was nominated for the Nobel Prize multiple times - in 1937, 1938, 1939, 1947 and 1948; before and  after India's independence. However he was never awarded a Nobel Prize.\n","question":"Did Gandhi win the Nobel Peace Prize?"},{"answer":"Homi Jehangir Bhabha was nominated fove times between 1951 and 1956 by  Jacques Hadamard for his discovery of the cascade process of cosmic radiation  and Bhabha Scattering in quantum electrodynamics. Bhabha never won a Nobel.\n","question":"what was Homi bhabha awarded the Nobel for?"},{"answer":"Har Gobind Khorana was born in 1922 in Multan district of Punjab, now part of Pakistan. Khorana immigrated to the United States.In 1968,  Khorana was awarded the Nobel Prize in Physiology or Medicine. He shared  the prize with American biochemists Marshall W. Nirenberg and Robert W. Holley.  The Nobel Prize was awarded \"for their interpretation of the genetic code and  its function in protein synthesis.\"\n","question":"Is Har Gobind Khorana an Indian Nobel laureate?"},{"answer":"Chandrasekhara Venkata Raman (C. V. Raman) won the 1930 Nobel Prize for Physics \"for his work on the scattering of light and for the discovery of the effect named after him.\" (the \"Raman Effect\").\n","question":"Who won the Nobel Prize for Physics in 1930?"},{"answer":"Teresa Bojaxhiu, better known as Mother Theresa, was an Indian citizen who won the Nobel Peace Prize \"for her work for bringing help to suffering  humanity\" in 1979.\n","question":"What did Mother Theresa win the Nobel for?"}],"task_description":"Knowledge contribution about Indian Nobel laureates","version":2}} 0x6d80e0 2192 [] false datagen-service-predictor-fmaas-rhods-testing.apps.fmaas-devstage-backend.fmaas.res.ibm.com map[] map[] <nil> map[]   <nil> <nil> <nil> 0xc0001f0e00 <nil> [] map[]}
jjasghar commented 2 weeks ago

It seems it happened again with: https://github.com/instructlab/taxonomy/pull/1200

nerdalert commented 2 weeks ago

@jjasghar this is resolved now. Was relayed there was a mismatch in the backend code that has since been bumped. Both of those jobs have SDG results now from test runs. Ty!