· Desktop Robot Development Practical Course· Exploring the Application Potential of Edge AI and Large Language Models 01 Course Background With the acceleration of digital transformation across various industries, edge AI and cloud-based large model technologies are leading a new wave of innovation in smart devices. This year, the Ministry of Industry and Information Technology … Read more
Source: DeepHub IMBA This article is approximately 2400 words long and is recommended for a 5-minute read. In this article, we will see how to use vLLM with multiple LoRA adapters. We all know that using LoRA adapters can customize large language models (LLMs). The adapters must be loaded on top of the LLM, and … Read more
MLNLP community is a well-known machine learning and natural language processing community at home and abroad, covering domestic and international NLP graduate students, university teachers, and corporate researchers. The vision of the community is to promote communication and progress between academia, industry, and enthusiasts in natural language processing and machine learning, especially for beginners. Selected … Read more
As the parameter count of large models continues to grow, the cost of fine-tuning the entire model has become increasingly unacceptable. To address this, a research team from Peking University proposed a parameter-efficient fine-tuning method called PiSSA, which surpasses the fine-tuning effects of the widely used LoRA on mainstream datasets. Paper Title: PiSSA: Principal Singular … Read more
Paper Title: LoRA: Low-Rank Adaptation of Large Language Models Authors: Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen Compiled by: Kuang Ji Reviewed by: Los Abstract: This article introduces a new approach for deploying large models, called LoRA, which reduces the number of parameters needed for … Read more
Introduction In recent years, artificial intelligence (AI) large language models have made rapid advancements, and the impact of AI on human society has expanded to an unprecedented extent. This article discusses some immature insights into the AI revolution brought by large language models from two physics-related perspectives—information and time scales. It first reviews the basic … Read more
This article is approximately 3200 words long and is recommended for an 8-minute read. This article will outline the key points related to the large language model (LLM) Agent and discuss the important directions for AI Agents in the era of large models. As large language models mature, various AI Agents based on them are … Read more
Click the blue text Follow us Deputy Leader of the Expert Group of the China Garment Intelligent Manufacturing Alliance Expert of the Industrial Expert Committee of the China Garment Association Professor of Donghua University, Wen Lisheng I have described in the article “The Garment Manufacturing Industry Must Recognize AI Large Models and Their Applications” that … Read more
Today, let’s talk about a particularly hot concept in the current technology field—AI Agents! The former world’s richest person wrote on his personal blog: AI Agent (AI Intelligent Agent/Assistant) “will completely change the way we use computers and disrupt the software industry.” He also predicted that “Android, iOS, and Windows are platforms; AI Agents will … Read more
Selected from Sebastian Raschka’s blog Translated by Machine Heart Editor: Jiaqi This is the experience derived from hundreds of experiments by the author Sebastian Raschka, worth reading. Increasing the amount of data and the number of model parameters is a widely recognized direct method to improve neural network performance. Currently, mainstream large models have parameter … Read more