MLNLP community is a well-known machine learning and natural language processing community at home and abroad, covering domestic and international NLP graduate students, university teachers, and corporate researchers. The vision of the community is to promote communication and progress between academia, industry, and enthusiasts in natural language processing and machine learning, especially for beginners. Selected … Read more
Originally from PaperWeekly Author: Dan Jiang Affiliation: National University of Singapore Generally speaking, the deployment of large language models follows the “pre-training – then fine-tuning” model. However, when fine-tuning a base model for numerous tasks (such as personalized assistants), the training and service costs can become very high. Low-Rank Adaptation (LoRA) is a parameter-efficient fine-tuning … Read more
The greatest science fiction writers probably never anticipated the invention of the internet. If the internet changed modern people, the rapidly developing Internet of Things (IoT) industry has even more to offer for the future. Whether it’s smart cities, smart homes, smart factories, or industries like construction, logistics, and public services, more and more “things” … Read more
As the parameter count of large models continues to grow, the cost of fine-tuning the entire model has become increasingly unacceptable. To address this, a research team from Peking University proposed a parameter-efficient fine-tuning method called PiSSA, which surpasses the fine-tuning effects of the widely used LoRA on mainstream datasets. Paper Title: PiSSA: Principal Singular … Read more
In the previous cartoon, we discussed the growth journey of the NB-IoT baby. In fact, there are many other babies in the LPWAN field that have already gone out to make money (though it’s mostly done privately by some companies). For example, LoRa, which has been commercially available since 2013, Sigfox from France, and ZETA … Read more
Author: Liu Yuwei EET Electronic Engineering Magazine Original As the Internet of Things (IoT) becomes the third wave of development in the global information industry after computers and the internet, the boundaries between people and things, and between things and things, are continuously being extended. The concept of connecting everything has greatly changed people’s existing … Read more
The mainstream method for fine-tuning LLMs, LoRA, has a new variant. Recently, NVIDIA partnered with Hong Kong University of Science and Technology to announce an efficient fine-tuning technique called DoRA, which achieves more granular model updates through low-rank decomposition of pre-trained weight matrices, significantly improving fine-tuning efficiency. In a series of downstream tasks, both training … Read more
With the continuous increase in the number of IoT devices, communication or connection between devices has become an important topic of consideration. Communication is very common and critical for IoT, whether it is short-range wireless transmission technology or mobile communication technology, both of which affect the development of IoT. Among these, communication protocols are especially … Read more
—— [Introduction] —— This article discusses the application and design ideas of low-power wide-area IoT technology in different scenarios, aiming to provide a practical judgment on the maturity of low-power wide-area IoT technology, the selection of application scenarios, and its importance in the field of IoT technology. 1. Background This article discusses the application and … Read more
Editor’s Note: Train a Lora in 15 minutes, Generate dozens of inspiration images in 3 minutes, Convenient parameter adjustments, Create your own AI assistant. In the AI era, Every designer should become an AI trainer. No need for scientific internet access, No computer configuration requirements, The “Academy” sibling company “Yiyuan AI” is currently open for … Read more