LLMEvaluator

This functionality requires an external account »

LLMEvaluator

is an option for functions such as LLMSynthesize that specifies the LLM configuration.

Details

Examples

open allclose all

Basic Examples  (3)

Run an LLM with an evaluator that specifies a prompt:

Start a chat conversation with an evaluator that specifies a prompt:

Specify multiple properties of a configuration:

Scope  (9)

Specify a token limit to the LLM-generated text:

Specify the service and the model to use for the generation:

Specify several prompts and how to join them together before submitting them to the LLM:

Specify that the sampling should be performed at zero temperature:

Specify the maximum cumulative probability before cutting off the distribution (aka nucleus sampling):

Specify the number of top-probability tokens to sample from:

Specify one or more alternative strings that will stop the LLM generation process:

Specify a tool that the LLM can call if needed:

Specify that tool calls should attempt to use the native API mechanism:

Wolfram Research (2023), LLMEvaluator, Wolfram Language function, https://reference.wolfram.com/language/ref/LLMEvaluator.html.

Text

Wolfram Research (2023), LLMEvaluator, Wolfram Language function, https://reference.wolfram.com/language/ref/LLMEvaluator.html.

CMS

Wolfram Language. 2023. "LLMEvaluator." Wolfram Language & System Documentation Center. Wolfram Research. https://reference.wolfram.com/language/ref/LLMEvaluator.html.

APA

Wolfram Language. (2023). LLMEvaluator. Wolfram Language & System Documentation Center. Retrieved from https://reference.wolfram.com/language/ref/LLMEvaluator.html

BibTeX

@misc{reference.wolfram_2024_llmevaluator, author="Wolfram Research", title="{LLMEvaluator}", year="2023", howpublished="\url{https://reference.wolfram.com/language/ref/LLMEvaluator.html}", note=[Accessed: 24-November-2024 ]}

BibLaTeX

@online{reference.wolfram_2024_llmevaluator, organization={Wolfram Research}, title={LLMEvaluator}, year={2023}, url={https://reference.wolfram.com/language/ref/LLMEvaluator.html}, note=[Accessed: 24-November-2024 ]}