Mastering Lora Training: A Step-by-Step Guide

Mastering Lora Training: A Step-by-Step Guide

Have you ever wondered why some people seem completely clueless about AI, yet confidently discuss its various benefits? Do they have a secret manual on Lora training hidden in their minds? Today, let me take you into this magical world and show you how we can gradually become little experts in AI! Understanding the Past … Read more

LoRA: Fine-Tuning SD Models Efficiently

LoRA: Fine-Tuning SD Models Efficiently

Hello everyone, this is Goodnote. This article provides a detailed introduction to the SD model fine-tuning method LoRA, including dataset preparation, model fine-tuning process, inference process, advantages and disadvantages, etc. Paper Paper URL:LoRA: Low-Rank Adaptation of Large Language Models [1] Concept LoRA (Low-Rank Adaptation of Large Language Models) is a technique for efficiently fine-tuning large … Read more

LoRA: Unlocking Low-Rank Adaptation Optimization

LoRA: Unlocking Low-Rank Adaptation Optimization

Click the blue text to follow us 01 Introduction In the fields of machine learning and deep learning, optimizing model parameters is key to improving model performance. Traditional optimization methods, such as Stochastic Gradient Descent (SGD), are effective but may encounter limitations in computational resources and time when dealing with large-scale models. To address these … Read more

Deep Dive into IoT: Starting with LoRa

Deep Dive into IoT: Starting with LoRa

Source: ArrowSeed Online Author: Ganda Published by IoT Think Tank Please indicate the source when reprinting —— 【Introduction】 —— LPWA currently includes various technologies such as LoRa, Sigfox, Weightless, and NB-IoT. Among these, LoRa entered China in 2013, and it is expected that the shipment of Semtech’s SX1278 LoRa chip in China will exceed 10 … Read more

Guide to Fine-Tuning Large Language Models with PyTorch: Complete Tutorial and Code Examples

Guide to Fine-Tuning Large Language Models with PyTorch: Complete Tutorial and Code Examples

About 5300 words, recommended reading time 8 minutes. This article introduces the significant advances made by large language models in the field of natural language processing. In recent years, large language models (Large Language Models, LLMs) have made significant progress in the field of natural language processing (Natural Language Processing, NLP). These models can acquire … Read more

Differences Between LoRA and Full Fine-Tuning Explained

Differences Between LoRA and Full Fine-Tuning Explained

Source: Machine Heart This article is approximately 2500 words long and suggests a reading time of 5 minutes. The aim of this article is to understand the differences between two methods of fine-tuning large language models: full fine-tuning and low-rank adaptation (LoRA). This article aims to understand the differences between two methods of fine-tuning large … Read more

Multi-LoRA Composition Without Training

Multi-LoRA Composition Without Training

Multi-LoRA Composition | Multi-LoRA Composition Without Training This article primarily introduces methods for switching and combining any number of LoRA without training. In simple terms, it means that the characteristics of each LoRA can be synthesized into a single image. For instance, three LoRAs representing characters, clothing, and objects can be combined into one image … Read more

What is LoRaWAN™? An Overview of LoRa and LoRaWAN Technologies

What is LoRaWAN™? An Overview of LoRa and LoRaWAN Technologies

LoRaWAN™ What is it? A technical overview of LoRa® and LoRaWAN Introduction This document aims to provide an introductory technical overview of LoRa® and LoRaWAN™. Low-Power Wide-Area Networks (LPWAN: Low–Power, Wide-Area Networks) are expected to support a significant portion of the billions of devices anticipated in the Internet of Things (IoT) space. LoRaWAN™ is designed … Read more

TinyML Breakthrough: Deploying 1KB Models with MicroTVM on LoRa

TinyML Breakthrough: Deploying 1KB Models with MicroTVM on LoRa

Hey, recently I’ve been tinkering with something fun — running machine learning on those tiny IoT devices! Seeing the number “1KB”, many people shake their heads: how is that possible? Indeed, a high-definition photo takes several MB, so where’s the magic that allows AI to fit into such a tiny space? Actually, TinyML is such … Read more