CAFE — Compound-AI Factorial Evaluation
Stop guessing which AI config is better. Prove it.
CAFE — Compound-AI Factorial Evaluation とは？
CAFE treats every knob in your AI pipeline - retrieval, reranking, prompts, models, and tools - as an experimental factor. It runs factorial experiments, evaluates outputs using a configurable LLM (and optionally human reviewers), and applies mixed-effects models to determine: - Which techniques actually improve quality - How much each technique contributes - Whether the observed differences are statistically significant Open source and self-hostable.
スクリーンショット
?
まだコメントはありません。最初のひとりになりましょう！
CAFE — Compound-AI Factorial Evaluation に関する X でのリアルな声
X に投稿