I have recently compiled a simple and easy-to-understand guide on the GPU memory requirements for fine-tuning with LoRA and QLoRA, which can help you estimate the memory needed when fine-tuning using LoRA and QLoRA. Below, we will explain step by step, requiring minimal background knowledge.1. What are LoRA and QLoRA? LoRA (Low-Rank Adaptation):This is a … Read more
As mentioned in previous articles, LoRA fine-tuning primarily targets the weight matrices of linear layers, such as the Q, K, and V projection matrices in the attention mechanism, as well as the weight matrices in the feedforward network (FFN). So, when fine-tuning a model with a Transformer architecture using LoRA, which weight matrices should we … Read more
Research on the Low Power Mechanism of LoRa Devices With the rapid development of Internet of Things (IoT) technology, Low Power Wide Area Network (LPWAN) technology has become one of the research hotspots in the field of wireless communication. LoRa technology, as one of the representatives of LPWAN technology, is widely used in smart cities, … Read more
In today’s world, using Bluetooth headphones to listen to music or wearing Bluetooth wristbands while running is nothing new. However, you might be surprised to learn that someone has researched Bluetooth tampons, aiming to solve the embarrassing problem of “leakage” during menstruation. 丨Image Source: trackmyflow.com A company called my.FLow has designed a tampon with an … Read more
As the post-90s generation gradually becomes the main force in car purchases, distinctive SUV models in the 100,000 yuan range are receiving increasing attention. Compared to sedans, the biggest features of SUVs are their spaciousness and better off-road capability. If you are not fond of mediocre SUV products, the three models introduced in this issue … Read more
The Bluetooth technology was born in 1994, invented by Ericsson, with the initial goal of enabling wireless audio transmission for wireless headsets. Now, Bluetooth applications are no longer limited to wireless headsets; keyboards and game controllers also have Bluetooth versions. However, the audio quality and stability of early Bluetooth were far from satisfactory. For instance, … Read more
Recently, the Yuan Nuo Technology Transfer Center successfully facilitated a collaboration between Dongtai Weilon Yicheng Intelligent Technology (Jiangsu) Co., Ltd. and Professor Zhang Bing’s team from the School of Electronics and Information at Xi’an Jiaotong University. The two parties will engage in deep cooperation in the field of optoelectronic sensors to further enhance elevator safety … Read more
Today, on the morning of April 2nd, after finishing a visit with a client, I stood outside the Chamber of Commerce building waiting for a Didi ride. In less than two minutes, a handsome guy approached me asking if I needed a loan; shortly after, a beautiful woman came over asking if I needed a … Read more
Add ⭐️Star Mark⭐️ to follow us and not get lost ① Open the Chinese Service Center WeChat public account homepage👆 ② Click the three dots in the upper right corner and select ‘Set as Star Mark’ ■ Please pay attention to parking According to media reports, some cities in Sydney have begun using little-known technology … Read more
If we compare a smart car to a “living organism,” then its sensors are its eyes, ears, and skin, responsible for perceiving the world, while the AI model acts as the brain, processing information and making decisions. The key to autonomous driving lies in the perfect combination of these two—perceiving the world, understanding the … Read more