As the parameter count of large models continues to grow, the cost of fine-tuning the entire model has become increasingly unacceptable. To address this, a research team from Peking University proposed a parameter-efficient fine-tuning method called PiSSA, which surpasses the fine-tuning effects of the widely used LoRA on mainstream datasets. Paper Title: PiSSA: Principal Singular … Read more
Paper Title: LoRA: Low-Rank Adaptation of Large Language Models Authors: Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen Compiled by: Kuang Ji Reviewed by: Los Abstract: This article introduces a new approach for deploying large models, called LoRA, which reduces the number of parameters needed for … Read more
Introduction In recent years, artificial intelligence (AI) large language models have made rapid advancements, and the impact of AI on human society has expanded to an unprecedented extent. This article discusses some immature insights into the AI revolution brought by large language models from two physics-related perspectives—information and time scales. It first reviews the basic … Read more
This article is approximately 3200 words long and is recommended for an 8-minute read. This article will outline the key points related to the large language model (LLM) Agent and discuss the important directions for AI Agents in the era of large models. As large language models mature, various AI Agents based on them are … Read more
Click the blue text Follow us Deputy Leader of the Expert Group of the China Garment Intelligent Manufacturing Alliance Expert of the Industrial Expert Committee of the China Garment Association Professor of Donghua University, Wen Lisheng I have described in the article “The Garment Manufacturing Industry Must Recognize AI Large Models and Their Applications” that … Read more
Today, let’s talk about a particularly hot concept in the current technology field—AI Agents! The former world’s richest person wrote on his personal blog: AI Agent (AI Intelligent Agent/Assistant) “will completely change the way we use computers and disrupt the software industry.” He also predicted that “Android, iOS, and Windows are platforms; AI Agents will … Read more
Selected from Sebastian Raschka’s blog Translated by Machine Heart Editor: Jiaqi This is the experience derived from hundreds of experiments by the author Sebastian Raschka, worth reading. Increasing the amount of data and the number of model parameters is a widely recognized direct method to improve neural network performance. Currently, mainstream large models have parameter … Read more
Machine Heart Column Machine Heart Editorial Team As the parameter size of large models continues to grow, the cost of fine-tuning the entire model has gradually become unacceptable. To address this, a research team from Peking University proposed a parameter-efficient fine-tuning method called PiSSA, which outperforms the widely used LoRA in fine-tuning effectiveness on mainstream … Read more
Recent major reports on trends for 2024 have all mentioned AI Agents. Accenture’s “Technology Outlook 2024” report indicates that 96% of executives believe that the application of AI Agent ecosystems will bring significant opportunities to their organizations in the next three years. The report suggests that as artificial intelligence evolves into agents, automation systems will … Read more
AI Agent (Artificial Intelligence Agent) is an intelligent entity capable of perceiving the environment, making decisions, and executing actions. Unlike traditional artificial intelligence, AI Agents have the ability to achieve specified goals through independent thinking and tool invocation. The distinction between AI Agents and large models lies in the fact that interactions between large models … Read more