Update for correct tool use system prompt

#90
by ricklamers - opened

cc @Rocketknight1 (I think you authored the chat_template?)

Hi @ricklamers , yes I did! We're on it - I'll let you know what decision we come to and if we're going to update the template.

Meta Llama org

Hi @Rocketknight1 wanted to add an extra request:

Right now, if we enable tool calling by passing the list of tools available, this gets sent to the model as a user message instead of system prompt. Can we please have this added to the system prompt instead?

Sign up or log in to comment