Choosing a model

Choose the model that best suits your needs, balancing speed, accuracy, and cost. Advanced models are better at reasoning and return more accurate results, but they’re slower and more expensive to use.

Model availability

The models available for use vary across AI Hub products. Some products also support different models when using the API compared to the user interface.

• Build offers the standard model and, for commercial and enterprise users, advanced model. You can switch to the advanced model for individual fields in the field editor.

• Converse offers the advanced and multistep models, as well as research mode. For queries to a single document, the advanced model is automatically used. For queries to multiple documents, the multistep model is automatically used. Research mode can be manually enabled for queries to a single or multiple documents. Research mode uses a more powerful but slower variant of the multistep model.

  • The Converse with a document endpoint, used to query conversations by API, offers the standard and advanced models.

• Chatbots offer the advanced and multistep models, as well as research mode. For queries to a single-document knowledge base, the advanced model is automatically used. For queries to a multiple-document knowledge base, the multistep model is automatically used. Research mode can be manually enabled for queries to a single-document or multiple-document knowledge bases. Research mode uses a more powerful but slower variant of the multistep model.

  • The Run query endpoint, used to query chatbots by API, offers the multistep model and research mode.

The following table provides a summary of model availability across AI Hub products.

Model capabilities

All models use certain capabilities in developing answers to your prompts, but they vary in complexity, accuracy, and approach. See the following table for a summary and comparison.

Standard model

The standard model is good at quickly analyzing most documents. It’s optimized for speed and cost, but it can be less accurate when it comes to longer documents, complex reasoning, or mathematics.

Standard model capabilities include:

• Search — Searches all pages in the document for information relevant to the prompt.

• Calculate — Performs basic mathematical calculations based on information found in the document.

• Extract tables — Extracts information from tables found in the document.

Advanced model

The advanced model is better at handling dense or complex documents, reasoning, and mathematics. The advanced model tends to give more accurate and detailed results.

Advanced model capabilities include:

• Search — Searches all pages in the document for information relevant to the prompt.

• Calculate — Performs mathematical calculations based on information found in the document. The advanced model is better at mathematics than the standard model.

• Extract tables — Extracts information from tables found in the document. The advanced model more accurately retrieves data from tables, especially long or multipage tables.

• Visualize — (Converse and chatbots only) Creates visualizations such as graphs and charts, if you request a graph or chart in the prompt.

Multistep model and research mode

When you give the multistep model a prompt, the model responds dynamically: it breaks your query down into a series of steps, executing each step before generating the next step. This step-by-step approach allows the multistep model to perform more complex reasoning and mathematics, better understand context, and return more robust and detailed answers. The same applies when using the more powerful but slower variant of the multistep model that’s used for research mode.

Multistep model capabilities include:

• Search — Searches all pages in the document for information relevant to the prompt. The multistep model performs reasoning or calculations based on the information it finds. It also returns details about what information it found, and where in the document it found the information.

• Calculate — Performs mathematical calculations based on information found in the document. Multistep model calculations are more accurate than those of the standard or advanced models.

• Extract tables — Extracts information from tables found in the document.

• Plan — The model considers its findings so far before determining its next step, resulting in more complete contextual answers.

The variant of the multistep model used for research mode shares the same capabilities, along with additional ones that make it well-suited to complex reasoning or computation queries. While in research mode, additional capabilities include:

• Evaluate — The model evaluates its potential response to make sure it’s accurate and answers the prompt. If needed, the model revises its response before returning it to you.

• Visualize — (Converse and chatbots only) Creates visualizations such as graphs and charts, if you request a graph or chart in the prompt.