Recently, I came across a teardown article by a netizen about a gas alarm, which features a simple circuit structure that differs from the power integrated chip solutions we usually see. The following image shows the teardown of the gas alarm.This solution steps down AC220V through a transformer to a secondary voltage of 10V, and … Read more
Title:A synergistic CNN-transformer network with pooling attention fusion for hyperspectral image classification Paper Link:https://doi.org/10.1016/j.dsp.2025.105070 Collaborative CNN-Transformer Architecture Design A synergistic CNN-Transformer network is proposed, combining the local spatial feature extraction capability of CNNs with the global modeling capability of Transformers, effectively achieving joint modeling of spectral and spatial information in hyperspectral images (HSI). Two-Branch Feature … Read more
Title:A synergistic CNN-transformer network with pooling attention fusion for hyperspectral image classification Paper link: https://doi.org/10.1016/j.dsp.2025.105070 1. Proposed Synergistic CNN-Transformer Network Structure: Combines the local spatial feature extraction capabilities of CNNs with the global spectral modeling capabilities of Transformers to comprehensively extract spatial-spectral features from hyperspectral images (HSI).2. Twin-Branch Feature Extraction Module (TBFE): Parallel combination of … Read more
In the realm of deep learning, the attention mechanism is akin to a master of its craft. Originally emerging in machine translation, Attention quickly became a powerful tool for addressing long sequence dependency issues, enabling models to focus on truly important information. This is similar to how, in a noisy gathering, your brain automatically filters … Read more
✅ Author Profile: A Matlab simulation developer passionate about research, skilled in data processing, modeling simulation, program design, complete code acquisition, paper reproduction, and scientific simulation. 🍎 Previous reviews, follow the personal homepage:Matlab Research Studio 🍊 Personal motto: Investigate to gain knowledge, complete Matlab code and simulation consultation available via private message. 🔥 Content Introduction … Read more
Introduction The previous article “Implementing LLM from Scratch with 200 Lines of Python” created a “poetry generator” starting from a “probabilistic” implementation, ultimately using PyTorch to realize a classic Bigram model. In the Bigram model, each character is only related to the previous character. Despite this, our <span>babygpt_v1.py</span> also outputs sentences like “Gradually realizing the … Read more
In the Transformer model,the Multi-head Attention Mechanism is indeed a key extension of the Self-Attention mechanism, with the core purpose of enhancing the model’s ability to capture different aspects of information in the input sequence by learning multiple sets of independent attention weights in parallel. Below is a detailed analysis from principles, implementation to advantages: … Read more
As mentioned in previous articles, LoRA fine-tuning primarily targets the weight matrices of linear layers, such as the Q, K, and V projection matrices in the attention mechanism, as well as the weight matrices in the feedforward network (FFN). So, when fine-tuning a model with a Transformer architecture using LoRA, which weight matrices should we … Read more
(1) The drive waveform of soft switch welding machines rises and falls at an angle, as shown in the figure below. The waveform of hard switch machines is like a single tube wave, rising and falling straight. Issues with absorption can cause spikes in the waveform. During maintenance, some waveforms may be unfamiliar; if the … Read more
Recently, a colleague at the company asked me: “Can an oscilloscope be directly connected to the 220V voltage between the live wire and the neutral wire? Will it blow up?” Because it indeed exploded once before, it left a lingering fear~ I believe many of you have similar questions, so today I will summarize this … Read more