Integrating MoE into LoRA: The Birth of a Paper

Integrating MoE into LoRA: The Birth of a Paper

Source: PaperWeekly This article is about 2800 words long and is recommended to be read in 6 minutes. This article mainly introduces how a paper is born. Nothing will work unless you do. ——Maya Angelou This article mainly introduces how a paper is born. The basic information of the article is as follows: Paper Title: … Read more

LoRA: Low-Rank Adaptation of Large Language Models

LoRA: Low-Rank Adaptation of Large Language Models

Paper Title: LoRA: Low-Rank Adaptation of Large Language Models Authors: Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen Compiled by: Kuang Ji Reviewed by: Los Abstract: This article introduces a new approach for deploying large models, called LoRA, which reduces the number of parameters needed for … Read more

Differences Between AI Chips and Traditional Chips

Differences Between AI Chips and Traditional Chips

The following content is organized from Zhihu: Author: Wang Peng Link:https://www.zhihu.com/question/285202403/answer/444253962First, let me answer the question, (1) There is a significant difference in performance compared to traditional chips, such as CPUs and GPUs. When executing AI algorithms, they are faster and more energy-efficient. (2) There is no difference in manufacturing processes; everyone is the same. … Read more

What Is Artificial Intelligence?

What Is Artificial Intelligence?

A few days ago, a dog became famous worldwide due to a game of Go with AlphaGo. So, at the request of a small number of students, I would like to share with everyone what is called artificial intelligence. The definition of artificial intelligence can be divided into two parts: “artificial” and “intelligence.” The term … Read more

Artificial Intelligence: A Major Energy Consumer, But What About Human Intelligence?

Artificial Intelligence: A Major Energy Consumer, But What About Human Intelligence?

Recently, OpenAI’s CEO Sam Altman claimed that the limiting factor for the future development of AI will be energy, and therefore, there is an urgent need to develop nuclear fusion. In fact, as early as 2021, he invested $375 million in a nuclear fusion company, which recently stated that its first power plant is expected … Read more

The Current Status and Future Trends of Intelligent Voice Chips

The Current Status and Future Trends of Intelligent Voice Chips

Introduction In recent years, with the rapid development and maturity of voice interaction technology, the voice industry has entered a phase of explosive growth. According to statistics from Analysys, the voice market reached a scale of 20 billion in 2017 (Figure 1). As it fully lands in markets such as smart speakers, smart homes, in-car … Read more

Daily Science | Concepts You Should Know About Artificial Intelligence (AI)

Daily Science | Concepts You Should Know About Artificial Intelligence (AI)

Concepts You Should Know About Artificial Intelligence (AI) Computing power refers to the ability to process data, as well as storage capacity, data transmission capabilities, and more. Large models refer to machine learning models with a large number of parameters and complex computational structures. Artificial neural networks are computational models that simulate the human brain’s … Read more

10 Essential Deep Learning Methods for AI Practitioners

10 Essential Deep Learning Methods for AI Practitioners

Source: Big Data Digest The length of this article is 5288 words, recommended reading time 10 minutes This article summarizes 10 deep learning methods suitable for four basic network architectures. Over the past decade, public interest in machine learning has grown significantly. Machine learning can be seen almost daily in computer science programs, industry conferences, … Read more

Implementing Neural Networks on FPGAs

Implementing Neural Networks on FPGAs

Author | Shawn Ouyang, System Architect at Ruijun Micro UK R&D Center; Dr. Andrew, Fellow at Ruijun Micro UK Research Center 1. Introduction FPGA is a device for implementing programmable digital logic. Similar to circuit architectures like CPU, GPU/NPU and dedicated ASIC, FPGAs have also begun to be widely used for implementing neural networks (NN). … Read more

Image Recognition SoC Based on E203 & ShuffleNet

Image Recognition SoC Based on E203 & ShuffleNet

The new year’s competition has kicked off enthusiastically~ To help everyone learn more about this event, the editor has compiled excellent works from 2021 for sharing and learning. Every Monday, we will share award-winning works, so remember to check out the series~ Team Introduction Participating Unit: University of Science and Technology of ChinaTeam Name: SupernovaFinals … Read more