presence_penalty parameter results in Internal Server Error | Voters

presence_penalty parameter results in Internal Server Error

planned

Cysio

When one includes the presence_penalty parameter when polling a model on serverless (tested with Deepseek R1 and Valkyrie), one gets an Internal Server Error.

5 hours ago

This post was marked as

planned

M.R.

Can you give more details, is it jsut one of the models are you using vLLM or openai endpoint?

Cysio

M.R. I'm using the https://api.parasail.io/v1 in the Text Completion mode through KoboldAI Lite (the OpenAI Compatible API option). I've pulled out the request that causes the issue, after removing presence_penalty it works:

{"max_tokens":200,"model":"parasail-deepseek-r1-0528","temperature":0.7,"top_p":0.6,"stop":["<｜end▁of▁sentence｜><｜User｜>","<｜end▁of▁sentence｜><｜Assistant｜>"],"presence_penalty":0,"prompt":"<｜end▁of▁sentence｜><｜User｜>test<｜end▁of▁sentence｜><｜Assistant｜>"}