dragon.ai.inference.llm_engine.chat_template_formatter

chat_template_formatter(system_prompt, user_prompt, chat_history, model_name)[source]

Format the prompt using the model’s chat template via its tokenizer.

Builds an OpenAI-format message list and applies the model’s native chat template using AutoTokenizer.apply_chat_template().

Parameters:
  • system_prompt (str or list [str ]) – System prompt to be included in the chat.

  • user_prompt (str ) – User prompt to be included in the chat.

  • chat_history (list [dict ]) – Previous chat history as a list of message dicts with role and content keys.

  • model_name (str ) – Name/path of the model (used to load tokenizer).

Returns:

Formatted prompt string ready for the LLM.

Return type:

str