There are 3 updates, 2 comments.
 
 
LLM AI Integration / cid:jira-generated-image-avatar-9fc676e0-14d3-46db-ab1b-1ba25caa2d75 LLMAI-170 Closed

Chat fails on models that reject an explicit temperature

 
View issue   ยท   Add comment
 

3 updates

 
cid:jira-generated-image-avatar-0d82b63f-b6d3-4c02-b38f-1a54600fab32 Changes by Paul Pantiru on 02/Nov/26 14:42
 
Fix Version: 1.0.1
Resolution: Fixed
Status: Open Closed
 
 

2 comments

 
cid:jira-generated-image-avatar-0d82b63f-b6d3-4c02-b38f-1a54600fab32 Paul Pantiru on 02/Nov/26 14:42
 

Fixed in 9c64cd5, in 1.0.1. The fix follows the shape from your follow-up comment rather than a per-model flag: "no temperature" is now the first-class default in both UIs and the field is only sent when a user sets one explicitly.

  • chatWidget.js: the default is unset (the settings box shows "default" as a placeholder), a 0 stored by earlier versions is reset to unset once, and aillm.js only serialises temperature when it is a finite number.
  • AI.Code.Javascript (wiki chat page and CKEditor plugin): the temperature is sent only when the prompt entry defines one or the user moved the slider; the accidental NaN path is gone.
  • The predefined PromptDB entries (Free Prompt, Summarize, Translate) no longer carry a temperature, so they inherit the provider default; a temperature can still be set per prompt.

Not done: the server-side setting for the widget's default, and per-model capability flags (top_p has the same restriction). 1.0.1 also drops the preconfigured hosted model pages. If a per-model flag is still needed after 1.0.1, please open a follow-up.

 
cid:jira-generated-image-avatar-0d82b63f-b6d3-4c02-b38f-1a54600fab32 Paul Pantiru on 02/Nov/26 14:45
 
Fixed in 9c64cd5, in 1.0.1. The fix follows the shape from your follow-up comment rather than a per-model flag: "no temperature" is now the first-class default in both UIs and the field is only sent when a user sets one explicitly.

* {{ {} chatWidget.js { }} } : the default is unset (the settings box shows "default" as a placeholder), a 0 stored by earlier versions is reset to unset once, and {{aillm.js}} only serialises {{temperature}} when it is a finite number.
* {{AI.Code.Javascript}} (wiki chat page and CKEditor plugin): the temperature is sent only when the prompt entry defines one
or the user moved the slider ; the accidental NaN path is gone.
* The predefined PromptDB entries (Free Prompt, Summarize, Translate) no longer carry a temperature, so they inherit the provider default; a temperature can still be set per prompt.

Not done: the server-side setting for the widget's default, and per-model capability flags ({{
{} top_p { }} } has the same restriction). 1.0.1 also drops the preconfigured hosted model pages. If a per-model flag is still needed after 1.0.1, please open a follow-up.