How do LLMs perform tool use and function calling?

LLMs use structured outputs to invoke external APIs or tools during inference.

Tool use involves training or prompting LLMs to output structured JSON or function signatures. A controller interprets these outputs and executes external tools like search engines, calculators, or databases, then feeds results back into the model.