Large Language Models

Leading the Future Smart Revolution: A Comprehensive Analysis of AI Agent Technology Development

by
Leading the Future Smart Revolution: A Comprehensive Analysis of AI Agent Technology Development

In the field of artificial intelligence, with the rise of large language models (LLMs), AI Agents are becoming the most notable technology hotspot of 2025. Unlike ordinary AI applications, AI Agents possess the ability to think independently, perceive their environment, and execute complex tasks, reshaping our understanding of artificial intelligence. This article will provide a … Read more

Implementation of Function Call Based on RK3588 Large Language Model

by
Implementation of Function Call Based on RK3588 Large Language Model

The example of function call invocation is as follows: POST /v1/chat/completions HTTP/1.1 Host: api.openai.com Authorization: Bearer YOUR_API_KEY Content-Type: application/json { "model": "gpt-4", "messages": [{"role": "user", "content": "What is the weather like in Beijing today?"}], "tools": [ // Define the tool list { "type": "function", "function": { "name": "get_weather", "description": "Get weather information for a specified … Read more

RK3588-Based rkllm Compatible with OpenAI API

by
RK3588-Based rkllm Compatible with OpenAI API

Usage: git clone https://github.com/huonwe/rkllm_openai_like_api.gitcd rkllm_openai_like_api Add the required dynamic libraries: sudo cp lib/*.so /usr/lib Installuv: curl -LsSf https://astral.sh/uv/install.sh | sh Installpythondependencies: uv sync Run: uv run server.py By default, the platform is set to rk3588, the model path is models/deepseek-r1-1.5b-w8a8.rkllm, and the listening port is 8080. You can manually specify parameters, such as uv run … Read more

Comprehensive Guide to Design Patterns for Generative AI Agents

by
Comprehensive Guide to Design Patterns for Generative AI Agents

When building new things, we all follow some time-tested methods, approaches, and patterns.This statement is particularly true for software engineers, but it may not be the case for generative AI and AI itself.For emerging technologies like generative AI, we lack documented patterns as a foundation for solutions. Image source: Wang Knowledge Author: Zhang Changwang, Wang … Read more

Comprehensive Survey on the Development and Application of AI Agents in 2023: Concepts, Principles, Development, Applications, Challenges, and Prospects

by
Comprehensive Survey on the Development and Application of AI Agents in 2023: Concepts, Principles, Development, Applications, Challenges, and Prospects

The field of Artificial Intelligence (AI) is rapidly evolving.Today’s AI agents are capable of perceiving, making decisions, and taking actions independently. With the rise of AI agents driven by large language models (LLMs), we are on the brink of a new era: AI agents may form their own societies and coexist harmoniously with humans. Newton … Read more

What is an AI Agent?

by
What is an AI Agent?

ChatGPT has released GPTs, and DingTalk has launched AI assistants. In the AI era, AI agents are the mainstream form of implementing large models in business scenarios. So, what is an AI Agent? 01 — What is an AI Agent? An AI Agent, or Artificial Intelligence Agent, is an entity capable of perceiving its environment, … Read more

Why the Next Stop for Artificial Intelligence is AI Agents?

by
Why the Next Stop for Artificial Intelligence is AI Agents?

Introduction: J.A.R.V.I.S from Iron Man In the movie Iron Man, J.A.R.V.I.S is an impressive AI assistant. As Tony’s capable aide, he is both reliable and intelligent, capable of connecting to any computer terminal, controlling Tony’s Iron Man suit, and discussing action plans with Tony. The success of J.A.R.V.I.S lies in his highly intelligent AI system, … Read more

In-Depth Analysis of AI Agents

by
In-Depth Analysis of AI Agents

1. Definition and Core Features An AI Agent is an intelligent system capable of perceiving its environment through sensors, making autonomous decisions, and utilizing tools to perform tasks. Its core features include: Autonomy: Operates without continuous human intervention. Goal-Oriented: Breaks down tasks and plans around predefined objectives. Adaptability: Dynamically adjusts strategies through feedback mechanisms. Interactivity: … Read more

Solving Composite Problems in One Inference: The MeteoRA Architecture for Scalable Integration of Knowledge Modules in Large Language Models Based on MoE

by
Solving Composite Problems in One Inference: The MeteoRA Architecture for Scalable Integration of Knowledge Modules in Large Language Models Based on MoE

In the field of large language models, the pre-training + fine-tuning paradigm has become an important foundation for deploying various downstream applications. Within this framework, the use of low-rank adaptation (LoRA) methods for efficient fine-tuning of large model parameters (PEFT) has resulted in a large number of reusable LoRA adapters tailored for specific tasks. However, … Read more

Solving Composite Problems in One Inference: The MeteoRA Architecture for Scalable Integration of Knowledge Modules in MoE-based Large Language Models

by
Solving Composite Problems in One Inference: The MeteoRA Architecture for Scalable Integration of Knowledge Modules in MoE-based Large Language Models

The AIxiv column is a section published by Machine Heart that features academic and technical content. Over the past few years, the AIxiv column has reported on more than 2000 pieces of content, covering top laboratories from major universities and companies worldwide, effectively promoting academic exchange and dissemination. If you have excellent work to share, … Read more