Core Principles of Web Crawlers: How an HTTP Request is Completed

Core Principles of Web Crawlers: How an HTTP Request is Completed

Author: Da Mu Jiang https://my.oschina.net/luozhou/blog/3003053 Overview In the previous article, “Do You Know What Happens Behind the Scenes When You Ping?” we analyzed the process of a <span>Ping</span> using actual packet capture (a common interview question). We learned that <span>ping</span> relies on the <span>ICMP</span> protocol and also involves <span>ARP</span> requests in a local area network. … Read more

An Overview of HTTP Request Methods

An Overview of HTTP Request Methods

Mind Map The HTTP request methods currently in mainstream use are quite fixed and have not changed significantly with major version upgrades. According to common, uncommon, and extended, they can be divided into the 3 categories shown above.To thoroughly understand these request methods, we need to consider several aspects: What was the original intention behind … Read more

Understanding HTTPS and SSL/TLS Protocols

Understanding HTTPS and SSL/TLS Protocols

To clearly explain the implementation principles of the HTTPS protocol, we need to understand at least the following background knowledge. 1. A rough understanding of several basic terms (HTTPS, SSL, TLS) 2. A rough understanding of the relationship between HTTP and TCP (especially “short connection” vs. “long connection”) 3. A rough understanding of the concept … Read more

Why Does HTTPS Return Large Data While HTTP Returns Line by Line?

Why Does HTTPS Return Large Data While HTTP Returns Line by Line?

Background: Recently, while debugging a ChatGPT dialogue website, I encountered issues with large data responses, leading me to use stream reading. The initial HTTP calls worked without any problems, but when switching to HTTPS in production, I kept facing errors. After struggling with this issue for two days, I finally resolved it with the help … Read more

Creating HTTP and HTTPS Servers and Clients with Node.js

Creating HTTP and HTTPS Servers and Clients with Node.js

Source | https://blog.csdn.net/ligang2585116/article/details/72827781 The HyperText Transfer Protocol (HTTP) is the most widely used network protocol on the Internet. All WWW files must comply with this standard. HTTP was originally designed to provide a method for publishing and receiving HTML pages. It belongs to the “Application Layer” of the seven-layer network protocol as shown in the … Read more

Efficient HTTP Large Data Requests Using Go Language Streaming Processing

Hi everyone, I am Hu Ge! Today, let’s talk about something hardcore — the streaming processing feature of Go language. You should know that in development, we often need to handle some large amounts of data, such as large file uploads or processing content that is generated gradually. At this point, if you are using … Read more

26 HTTP and HTTPS Interview Questions with Answers

26 HTTP and HTTPS Interview Questions with Answers

The web front end is the page result that users see when they type a line of letters in the browser’s address bar. However, what happens from typing letters to seeing the page, and how data is obtained, all rely on HTTP/HTTPS. However, this part is often overlooked by readers, so candidates need to gather … Read more

Learn Interface Testing from Scratch – HTTP Message Structure

Learn Interface Testing from Scratch - HTTP Message Structure

1. HTTP Request/Response Message 1. HTTP Communication Process: The client sends a request to the server, and the server returns a response to the client. 2. Message: The message: Information exchanged between the HTTP protocol client and server. It is divided into message header and message body. Request message: The request information submitted by the … Read more

HTTPS Interface Encryption and Authentication

HTTPS Interface Encryption and Authentication

1. Why Use HTTPS Instead of HTTP 1.1 Differences Between HTTPS and HTTP 1) The HTTPS protocol requires a certificate application from a CA, and generally, free certificates are rare and often require payment. 2) HTTP is the Hypertext Transfer Protocol, where information is transmitted in plain text, while HTTPS is a secure SSL encrypted … Read more

A Brief Discussion on HTTP and RPC

A Brief Discussion on HTTP and RPC

Source: blog.csdn.net/m0_38110132/ article/details/81481454 OSI Network Seven Layer Model RPC Service RPC Architecture Sync and Async Calls Popular RPC Frameworks HTTP Service Summary For a long time, I haven’t really clarified the difference between RPC (Remote Procedure Call) and HTTP calls. Aren’t they just about writing a service and then calling it on the client side? … Read more