search

jnehring / llm_tools

0 stars 1 forks source link

max_new_tokens parameter crashes the api #13

Closed jnehring closed 1 year ago

jnehring commented 1 year ago 
curl --location 'http://serv-9205.kl.dfki.de:5000/api/generate?max_new_tokens=10' \
--header 'content-type: application/json' \
--data '{
    "doc": "Title: Immune_system\n\nBackground: Pattern recognition receptors are proteins used by nearly all organisms to identify molecules associated with pathogens. Antimicrobial peptides called defensins are an evolutionarily conserved component of the innate immune response found in all animals and plants, and represent the main form of invertebrate systemic immunity. The complement system and phagocytic cells are also used by most forms of invertebrate life. Ribonucleases and the RNA interference pathway are conserved across all eukaryotes, and are thought to play a role in the immune response to viruses.\n\nQuestion: What pathway that plays a role in immune response to viruses is present in all eukaryotes?\n\nAnswer:"}'