evaluation metrics

Comprehensive Analysis of Multi-Agent Technology and Applications (Technical Edition)

by
Comprehensive Analysis of Multi-Agent Technology and Applications (Technical Edition)

Cover Image: nice view｜Source: Hailey I enjoy learning with “questions and curiosity”, which helps to systematize and solidify knowledge rather than just accumulating information. Follow this series of articles to explore 11 questions, which will greatly assist you in familiarizing yourself with Agent and Multi-agent technology. The next article will discuss the industry applications of … Read more

A Review of LLM Meta-Thinking via Multi-Agent Reinforcement Learning

by
A Review of LLM Meta-Thinking via Multi-Agent Reinforcement Learning

Imagine asking an LLM, “Did Aristotle use a laptop?” It might seriously fabricate a reason: “There was already wireless internet in ancient Greece…” This phenomenon of “seriously nonsense” is what we call the LLM’s “hallucination.” Paper: Meta-Thinking in LLMs via Multi-Agent Reinforcement Learning: A Survey Link: https://arxiv.org/pdf/2504.14520 The paper points out that meta-thinking— the ability … Read more

Why Do Multi-Agent LLM Systems Fail?

by
Why Do Multi-Agent LLM Systems Fail?

Why do multi-agent LLM systems fail? Abstract Despite the growing enthusiasm for multi-agent systems (MAS), which consist of multiple LLM agents collaborating to complete tasks, their performance improvements in popular benchmark tests remain minimal compared to single-agent frameworks. This gap highlights the necessity of analyzing the challenges that hinder the efficiency of MAS. In this … Read more