Exploration Robotics

Overview of a Combustible Gas Monitoring System Based on LoRa Technology

by
Overview of a Combustible Gas Monitoring System Based on LoRa Technology

Haitao Zhang, Yaozhen Han （Shandong Jiaotong University, School of Information Science and Electrical Engineering, Shandong Jinan 250357） Abstract：This paper addresses the issues of short communication transmission distance and high power consumption in current combustible gas monitoring systems, and proposes a design scheme for a combustible gas monitoring system based on LoRa technology, providing the overall … Read more

Deploying Multiple LoRA Adapters on a Base Model with vLLM

by
Deploying Multiple LoRA Adapters on a Base Model with vLLM

Source: DeepHub IMBA This article is approximately 2400 words long and is recommended for a 5-minute read. In this article, we will see how to use vLLM with multiple LoRA adapters. We all know that using LoRA adapters can customize large language models (LLMs). The adapters must be loaded on top of the LLM, and … Read more

Cost-Effective Fine-Tuning with LoRA for Large Models

by
Cost-Effective Fine-Tuning with LoRA for Large Models

MLNLP community is a well-known machine learning and natural language processing community at home and abroad, covering domestic and international NLP graduate students, university teachers, and corporate researchers. The vision of the community is to promote communication and progress between academia, industry, and enthusiasts in natural language processing and machine learning, especially for beginners. Selected … Read more

Single-GPU Operation for Thousands of Large Models: UC Berkeley’s S-LoRA Method

by
Single-GPU Operation for Thousands of Large Models: UC Berkeley's S-LoRA Method

Originally from PaperWeekly Author: Dan Jiang Affiliation: National University of Singapore Generally speaking, the deployment of large language models follows the “pre-training – then fine-tuning” model. However, when fine-tuning a base model for numerous tasks (such as personalized assistants), the training and service costs can become very high. Low-Rank Adaptation (LoRA) is a parameter-efficient fine-tuning … Read more

Focusing on Community and Open Source to Create Standardized Products for Diverse IoT Needs

by
Focusing on Community and Open Source to Create Standardized Products for Diverse IoT Needs

The greatest science fiction writers probably never anticipated the invention of the internet. If the internet changed modern people, the rapidly developing Internet of Things (IoT) industry has even more to offer for the future. Whether it’s smart cities, smart homes, smart factories, or industries like construction, logistics, and public services, more and more “things” … Read more

New Method PiSSA Significantly Enhances Fine-Tuning Effects

by
New Method PiSSA Significantly Enhances Fine-Tuning Effects

As the parameter count of large models continues to grow, the cost of fine-tuning the entire model has become increasingly unacceptable. To address this, a research team from Peking University proposed a parameter-efficient fine-tuning method called PiSSA, which surpasses the fine-tuning effects of the widely used LoRA on mainstream datasets. Paper Title: PiSSA: Principal Singular … Read more

Understanding LoRa Through a Cartoon Explanation

by
Understanding LoRa Through a Cartoon Explanation

In the previous cartoon, we discussed the growth journey of the NB-IoT baby. In fact, there are many other babies in the LPWAN field that have already gone out to make money (though it’s mostly done privately by some companies). For example, LoRa, which has been commercially available since 2013, Sigfox from France, and ZETA … Read more

How NB-IoT, eMTC and LoRa Complement Each Other in LPWAN Technologies

by
How NB-IoT, eMTC and LoRa Complement Each Other in LPWAN Technologies

Author: Liu Yuwei EET Electronic Engineering Magazine Original As the Internet of Things (IoT) becomes the third wave of development in the global information industry after computers and the internet, the boundaries between people and things, and between things and things, are continuously being extended. The concept of connecting everything has greatly changed people’s existing … Read more

NVIDIA Introduces New SOTA Fine-Tuning Method for LLMs: LoRA

by
NVIDIA Introduces New SOTA Fine-Tuning Method for LLMs: LoRA

The mainstream method for fine-tuning LLMs, LoRA, has a new variant. Recently, NVIDIA partnered with Hong Kong University of Science and Technology to announce an efficient fine-tuning technique called DoRA, which achieves more granular model updates through low-rank decomposition of pre-trained weight matrices, significantly improving fine-tuning efficiency. In a series of downstream tasks, both training … Read more

Understanding IoT Communication Protocols: 5G, NB-IoT, LoRa, ZigBee, NFC

by
Understanding IoT Communication Protocols: 5G, NB-IoT, LoRa, ZigBee, NFC

With the continuous increase in the number of IoT devices, communication or connection between devices has become an important topic of consideration. Communication is very common and critical for IoT, whether it is short-range wireless transmission technology or mobile communication technology, both of which affect the development of IoT. Among these, communication protocols are especially … Read more