Cost-Effective Fine-Tuning with LoRA

Cost-Effective Fine-Tuning with LoRA

Selected from Sebastian Raschka’s blog Translated by Machine Heart Editor: Jiaqi This is the experience derived from hundreds of experiments by the author Sebastian Raschka, worth reading. Increasing the amount of data and the number of model parameters is a widely recognized direct method to improve neural network performance. Currently, mainstream large models have parameter … Read more

New PiSSA Method From Peking University Enhances Fine-Tuning

New PiSSA Method From Peking University Enhances Fine-Tuning

Machine Heart Column Machine Heart Editorial Team As the parameter size of large models continues to grow, the cost of fine-tuning the entire model has gradually become unacceptable. To address this, a research team from Peking University proposed a parameter-efficient fine-tuning method called PiSSA, which outperforms the widely used LoRA in fine-tuning effectiveness on mainstream … Read more

Top 10 Research Directions for AI Agents

Top 10 Research Directions for AI Agents

Recent major reports on trends for 2024 have all mentioned AI Agents. Accenture’s “Technology Outlook 2024” report indicates that 96% of executives believe that the application of AI Agent ecosystems will bring significant opportunities to their organizations in the next three years. The report suggests that as artificial intelligence evolves into agents, automation systems will … Read more

AI Agent: Autonomous Intelligent Agents Based on Large Models

AI Agent: Autonomous Intelligent Agents Based on Large Models

AI Agent (Artificial Intelligence Agent) is an intelligent entity capable of perceiving the environment, making decisions, and executing actions. Unlike traditional artificial intelligence, AI Agents have the ability to achieve specified goals through independent thinking and tool invocation. The distinction between AI Agents and large models lies in the fact that interactions between large models … Read more

Comprehensive Analysis of AI Agents: Definition, Evolution, Applications, and Business Value

Comprehensive Analysis of AI Agents: Definition, Evolution, Applications, and Business Value

Since the emergence of large language models, the popularity of AI Agents has been on the rise, seen as a viable path towards AGI (Artificial General Intelligence). Personally, when using AI products like GPT, I not only enjoy their convenience in handling daily tasks, such as assisting with information collection and validating the feasibility of … Read more

Understanding AI Agents with ERNIE SDK and Multi-Tool Orchestration

Understanding AI Agents with ERNIE SDK and Multi-Tool Orchestration

In the past year, the rapid development of general large language models (LLMs) has attracted global attention. Tech giants like Baidu have launched their own large models, continuously pushing the performance limits of language models. However, the industry’s goals for LLMs are no longer limited to basic Q&A functions, but are seeking to utilize large … Read more

AI Agents: Transforming the Real World

AI Agents: Transforming the Real World

Click the above Lenovo Holdings Micro Space → Top right corner··· button → Set as a star⭐ Imagine, there is a “TA” next to you: When you wake up in the morning, TA has already booked your breakfast, adjusted the room temperature and lighting, and even recommended today’s outfit based on your schedule and the … Read more

Granite Guardian: Risk Detection Measures for RAG Models

Granite Guardian: Risk Detection Measures for RAG Models

Welcome to Agent Daily, summarizing Agent papers every morning. RAG Direction: Paper Title:Granite Guardian Paper Link: http://arxiv.org/abs/2412.07724v1 Publication Date:2024-12-10 Authors:Inkit Padhi Abstract:We introduce the Granite Guardian model, a set of risk detection safety measures designed to provide risk detection for prompts and responses, which can be combined with any large language model (LLM) to ensure … Read more

Academic Sharing | The Development History of AI Agents: From RL-Driven to Large Model-Driven

Academic Sharing | The Development History of AI Agents: From RL-Driven to Large Model-Driven

Reprinted from AI Technology ReviewInsights into the replication of Manus from cutting-edge research on agents. The emergence of Manus has pushed agents to the forefront of the current AI landscape, making this previously somewhat abstract concept tangible. However, there is no shortage of controversy in the industry regarding Manus, with critics arguing that it lacks … Read more