Source: Linux Technology Enthusiast What exactly happens to a complete network packet from the network card to the application? Why can zero-copy technology improve network performance by dozens of times? As operations engineers, we deal with various network issues every day. But do you really understand how, when a user clicks a link, the packet … Read more
Zero-Copy Bridges Between Python and Rust: 5 Practical PyO3 Patterns Introduction In the practice of mixed programming with Python and Rust, we often encounter a crucial performance bottleneck that is frequently overlooked: the repeated copying of data when passing across language boundaries. Imagine that you have meticulously crafted a high-performance Rust function, wrapped with PyO3 … Read more
In the field of high-performance programming, data copying is one of the key bottlenecks affecting system throughput. In traditional IO operations, data often needs to be transferred multiple times between user space and kernel space, accompanied by redundant copying overhead.The core goal of zero-copy technology is toreduce or eliminate unnecessary data copying, significantly improving the … Read more
Introduction: Why is DMA-BUF Needed? In modern heterogeneous computing systems, multiple processing units (CPU, GPU, ISP, video codecs, etc.) need to share data efficiently. Traditional data sharing methods involve frequent memory copies, which can incur significant performance overhead in scenarios such as high-resolution video processing and complex graphics rendering. DMA-BUF was developed to provide a … Read more
Cista is a C++ library focused on high-performance serialization and zero-copy deserialization, making it ideal for applications with stringent performance requirements. The library is designed with efficiency in mind and is easy to integrate into projects. The table below summarizes the main features of Cista for quick reference: Feature Category Details Core Features Serialization and … Read more
Introduction When you first rewrite Python’s performance bottlenecks in Rust, eagerly anticipating performance improvements, only to find that performance analysis shows 60% of the time wasted on hidden data copies—this experience can be both amusing and frustrating. In fact, when passing large-scale data between Python and Rust, boundary handling is more important than kernel algorithms. … Read more
1. Core Concepts of Zero-Copy Technology in C++ Zero-copy is an important optimization technique aimed at reducing unnecessary data copying in memory, thereby improving program performance, reducing memory usage, and decreasing CPU consumption. In C++, zero-copy techniques are implemented in various ways, including reference semantics, view types, and move semantics. 2. Introduction to std::string_view std::string_view … Read more
In-Depth Analysis of Linux Zero-Copy Technology Overview Zero-copy is an efficient data transfer technology designed to reduce CPU involvement in data copying operations, thereby improving system performance and reducing CPU load. In the Linux kernel, zero-copy technology is implemented through various mechanisms, including <span>sendfile()</span>, <span>splice()</span>, <span>copy_file_range()</span>, <span>mmap()</span>, and DMA (Direct Memory Access). Working Principle Traditional … Read more
Overview A high-throughput, low-latency logging system relies on two key aspects: deferring synchronous write delays to the background (asynchronous) and minimizing memory copies (zero-copy). This article provides engineering-level implementation ideas, reusable code snippets, and performance comparisons, suitable for direct adaptation in production systems. In Short • Decouple log collection (format) from disk writing: the main … Read more
Previously, we introduced several Linux zero-copy technologies, among which sendfile and splice are very similar. Both system calls allow data to be moved/copied directly in kernel space without passing through user space. In this article, we will analyze the kernel source code of these two system calls to see how they achieve zero-copy. 1. Analysis … Read more