How to Code LoRA From Scratch: A Tutorial

How to Code LoRA From Scratch: A Tutorial

The author states: Among various effective LLM fine-tuning methods, LoRA remains his preferred choice. LoRA (Low-Rank Adaptation) is a popular technique for fine-tuning LLMs (Large Language Models), initially proposed by researchers from Microsoft in the paper “LORA: LOW-RANK ADAPTATION OF LARGE LANGUAGE MODELS”. Unlike other techniques, LoRA does not adjust all parameters of the neural … Read more

Differences Between LoRA and Full Fine-Tuning Explained in MIT Paper

Differences Between LoRA and Full Fine-Tuning Explained in MIT Paper

MLNLP community is a well-known machine learning and natural language processing community both domestically and internationally, covering NLP graduate students, university teachers, and corporate researchers. The vision of the community is to promote communication and progress between the academic and industrial circles of natural language processing and machine learning, especially for beginners. Reprinted from | … Read more

Understanding LoRA: Low-Rank Adaptation for Large Language Models

Understanding LoRA: Low-Rank Adaptation for Large Language Models

Introduction LoRA (Low-Rank Adaptation of Large Language Models) is a very practical fine-tuning framework for large models. Before the emergence of LoRA, I used to manually modify parameters, optimizers, or layer counts to “refine” models, which was extremely blind. However, the LoRA technique allows for quick fine-tuning of parameters. If the results after LoRA fine-tuning … Read more

Exploring Medical Robots

Exploring Medical Robots

The growing needs for a better life among the people have spurred new demands for technological development. Medical robots, as the “crown jewel of the robotics industry,” are a key development direction in the fields of robotics and medical devices, and they are also an important focus for enhancing the technological level of medical and … Read more

Top 10 Cutting-Edge Technologies in Robotics

Top 10 Cutting-Edge Technologies in Robotics

In recent years, the robotics industry has developed rapidly, with robots being widely used in various fields, especially in industry. It is not difficult to see their enormous potential. At the same time, we must recognize that the booming development of the robotics industry relies on advanced scientific research progress and technical support. What are … Read more

Daily Science: A Detailed Analysis of How Robots Work

Daily Science: A Detailed Analysis of How Robots Work

When many people hear the word “robot“, they might think of terms like “cool design”, “powerful functions”, and “high-end”, imagining robots as something high-tech and flashy like the “Terminator” in science fiction movies. However, this is not the case. In this article, we will explore the basic concepts of robotics and understand how robots accomplish … Read more

Research on Humanoid Robot Motor Industry: New Growth Opportunities

Research on Humanoid Robot Motor Industry: New Growth Opportunities

(Report produced by: Shanghai Securities, Liu Yangdong, Wu Tingting) 1. Robot Drive Method: Mainly Motor The robot primarily uses motors as its drive method The drive methods for robots can be divided into hydraulic drive, pneumatic drive, and motor drive, among which motor drive is the most widely used method, offering advantages such as high … Read more

Understanding Intelligent Robots

Understanding Intelligent Robots

Intelligent Robots We understand the so-called intelligent robots in a broad sense, and the most profound impression it gives is a unique self-controlling “living being”. In fact, the main organs of this self-controlling “living being” are not as subtle and complex as those of a real person. Intelligent robots possess various internal and external information … Read more

Six Key Points About Humanoid Robots You Need to Know

Six Key Points About Humanoid Robots You Need to Know

It seems that everyone is curious about the world of humanoid robots! Imagine having a robotic butler at home in the future, helping you with cleaning, cooking, and even chatting with you. Doesn’t it sound like life would become more interesting and easier? Here are the points you need to know about humanoid robots: 1. … Read more

Understanding the Development History of Robotics Technology

Understanding the Development History of Robotics Technology

Robotics technology is a high-tech field that integrates multiple disciplines such as computer science, control theory, mechanics, information and sensing technology, artificial intelligence, and bionics. It is an area of active research and increasingly widespread application in contemporary society. The application of robotics is an important indicator of a country’s industrial automation level. Robots do … Read more