How would different LLMs or versions of the same LLM affect final outcomes?

The final outcomes would be affected by the ability of the LLMs to understand the user question and call the right tools to answer it. Usually, more recent versions of LLMs have better performance on a tool call task as shown here. Also, switching from one LLM to another means doing the necessary changes in prompting and context engineering to reach the best results possible for a given LLM (to be assessed via our evaluation automations)