Output Quality Evaluator (LLM-as-Judge)
Evaluate the following output [output text] for [criteria such as accuracy, clarity, relevance], and provide a score and reasoning.
📅
Tag: AI
Retrieval Accuracy Evaluator
Check if the retrieved documents [retrieved data] fully answer the query [query]. Flag missing or irrelevant information.
Source-Grounded Answer (Hallucination Guard)
For the question [query], provide an answer strictly based on the following verified sources: [sources].
Transparency-First Explanation
Answer [query] and then explicitly explain the reasoning process and sources used.
A/B Prompt Optimizer
Given Prompt A: [prompt A] and Prompt B: [prompt B], compare outputs and determine which better meets [criteria]. Explain why.
Hybrid Search Synthesizer
Using both keyword and semantic search results provided in [context], create a unified answer to [query].
Recursive Retrieval Planner
Start with the provided query: [query]. Retrieve small chunks of relevant data first, then expand retrieval scope to larger context for detail enrichment.
Sub-Query Generator
Break down the query [complex query] into smaller sub-queries targeting different data sources.
Prompt Tester & Refiner
Evaluate the prompt [prompt text] for clarity, specificity, and bias. Suggest improvements in structure and content.
Prompt Error Diagnoser
Analyze why the following prompt [prompt text] did not produce the desired result. Suggest fixes.