Tool usage?
Where is the tool usage/function calling in the template? Does gemma3 lack this capability?
According to Google, it supports Tool Calling. However, the template does not include tool calling, which is a bit strange.
The tokenizer_config.json file has nothing about tools or function_calling ???
looking into the Ollama git, it was confirmed that function calling is not included yet
https://github.com/ollama/ollama/issues/9680
Ah, I see the one post in that thread of someone who actually worked with Google team, so it's being 'looked into.' They probably shouldn't have added the function calling capability to their blog post then, sort of false advertising.
Gemma 3 is great at instructability. We did some testing with various prompts which include tool call definition and output definition and have gotten good results. That said, Gemma 3 does not come with a dedicated tool use token. We invite you to try your own styles. We didn't recommend one yet because we didn't want to bias your all experimentation and tooling. This continues to be top of mind for us though.
@Renu11 , Thanks for that information. If you wouldn't mind clarifying something (if only in my own confusion), I was under the impression that the use of a tool token was established and reinforced through post-training steps, in the same way that the "system", "assistant", and "user" roles are. If that is the case, wouldn't/shouldn't there be a standardized way of invoking the function_call feature to align with post-training methods and not really left up to experimentation?