

Evaluating models for behavior and performance through simulated games
Evaluating models for social behavior, safety, and performance through multi-agent simulated games. We use popular games like Catan, Risk, or Poker, and make humans come play them against talking AI opponents, but on the backend we're actually running a multi-agent environment used to evaluate the models for skill and behavior over large sample sizes. You can play in Social Arena and view our preliminary benchmarks today at https://olamlabs.ai/
아직 댓글이 없어요. 가장 먼저 남겨보세요!
Olam Labs에 대한 X의 실제 대화
X에 게시