Skip to content

Conversation

@mathurk
Copy link
Collaborator

@mathurk mathurk commented Feb 3, 2026

Legacy Evaluators should check for empty values and send an error if expected output is empty. We don't need this for non-legacy evaluators.

@github-actions github-actions bot added test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository labels Feb 3, 2026
agent_run_history: Any,
) -> str:
"""Create the evaluation prompt for the LLM."""
# Validate that expected agent behavior is not empty
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

add tests

@Chibionos
Copy link
Contributor

add sample for testing this particular scenario.

@mathurk mathurk force-pushed the fix/empty_expected_output_legacy_evals branch from 8ab178d to 67085f8 Compare February 3, 2026 23:16
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

test:uipath-langchain Triggers tests in the uipath-langchain-python repository test:uipath-llamaindex Triggers tests in the uipath-llamaindex-python repository

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants