Introduction to Python Web Scraping: From Understanding Protocols to Data Collection

Introduction to Python Web Scraping: From Understanding Protocols to Data Collection

In the data-driven era, web data collection (commonly known as “web scraping”) has become an important means of obtaining information. Proper use of this technology can significantly enhance work efficiency, but it must be based on compliance as a fundamental premise. 1. Legality of Web Scraping: Boundaries and Principles of the Gray Area 1. Gray … Read more

Basic Usage of the urllib Module in Python Web Scraping

Basic Usage of the urllib Module in Python Web Scraping

Hello everyone, I am Mengmeng, your learning assistant.~ In the last article, we introduced the HTTP protocol, which includes the request and response parts. A request is when the client sends request information to the server, and after receiving the request, the server processes it and returns a response. From the above image and the … Read more

Bypassing WAF at the HTTP Protocol Level

Bypassing WAF at the HTTP Protocol Level

PS: This article is for technical analysis only and is prohibited for other illegal uses. First, let me introduce myself. I’m a novice who started learning Web penetration testing in 2017. The reason? Of course, my own website was hacked… Getting to the point, as security awareness increases, enterprises are paying more attention to the … Read more

JavaWeb Tutorial: Servlet Definition and Environment Configuration for BS and CS Programs

JavaWeb Tutorial: Servlet Definition and Environment Configuration for BS and CS Programs

With the continuous development of network technology, standalone software programs can no longer meet the demands of networked computers. As a result, various network program development architectures have emerged. Among them, the most commonly used network application development architectures can be divided into two types: the Client/Server (C/S) structure and the Browser/Server (B/S) structure. Below, … Read more

HttpServlet and HttpServletRequest Interface

HttpServlet and HttpServletRequest Interface

HttpServlet and HttpServletRequest Interface HTTP Protocol Overview of HttpServlet Overview of HttpRequest Interface Some Insights and Thoughts 1. HTTP Protocol What is HTTP? The HTTP protocol, short for Hyper Text Transfer Protocol, is a protocol used for transferring hypertext from a server (WWW: World Wide Web) to a local browser. The HTTP protocol operates on … Read more

Step-by-Step Guide to Setting Up an Embedded Web Server on a Development Board

Step-by-Step Guide to Setting Up an Embedded Web Server on a Development Board

Follow+Star Public Account Number to not miss exciting content Source | Embedded Miscellaneous This article provides a step-by-step guide to setting up a web server on a development board in 10 minutes. The article “What are the Common Embedded Web Servers?“ shares several web servers that can be used in embedded systems. An embedded web … Read more

What is the HTTP Listening Function of Hikvision Surveillance Cameras? How to Configure It?

What is the HTTP Listening Function of Hikvision Surveillance Cameras? How to Configure It?

The device sends alarm information to the destination IP or domain name via the HTTP protocol, requiring the destination IP or domain name to support HTTP protocol for receiving alarm information. Supports HTTP protocol alarm uploads for events such as face capture, mixed target detection, road monitoring, smart city management, smart events, queue detection, hard … Read more