In today’s digital age, web requests have become an indispensable part of software development. Whether it’s fetching web content, calling API interfaces, uploading and downloading files, or implementing automated testing, web requests are essential. For Python programmers, the Requests library is the preferred tool for making HTTP requests. Requests is an elegant and simple HTTP … Read more
Tips: Some records, some notes 2025/07/20 SUNDAY Isn’t it sad to buy out all your time and dreams for a few thousand dollars a month? —— Warren Buffett 01 Pyppeteer Note that the module introduced here is Pyppeteer, not Puppeteer. Puppeteer is a tool developed by Google based on Node.JS, which can control some operations … Read more
▼ Click the card below to follow me ▲ Click the card above to follow me Who is still struggling with requests? This year, httpx has quietly reached the threshold and become the new “top player” in Python network requests. Don’t be fooled by its name, which sounds like requests’ younger brother; it actually has … Read more
How can a Python web scraper do without Requests? This HTTP tool is simply a Swiss Army knife for data acquisition! Whether it’s scraping a webpage, calling an API, or downloading a file, just a few lines of code will do the trick without the hassle of low-level details. Today, let’s take a look at … Read more
HTTP Request Process A complete HTTP request process includes DNS requests and responses, domain name resolution, TCP connection, three-way handshake, server response to the HTTP request, browser parsing and rendering of HTML, and finally, the server closes the TCP connection with a four-way handshake. Step 1: DNS Resolution The local DNS uses recursive queries to … Read more
In today’s internet era, web services are ubiquitous, and the exchange and retrieval of data have become crucial. Whether it’s fetching remote API data, submitting forms, downloading files, or developing web crawlers, dealing with the HTTP protocol is essential. The Python <span>Requests</span> library serves as an elegant HTTP request library for Python, providing developers with … Read more
Web scraping made easy! The Scrapy framework helps you say goodbye to the nightmare of “manual” web scraping Have you ever been troubled by the question – every time you scrape a webpage, do you have to manually write requests, parse, and store? Writing a small scraper is easy, but when the project gets larger, … Read more
1. Introduction to Python 1. Why Learn Python? Before learning Python, don’t worry about having no background or being “slow”. I firmly believe that as long as you want to learn and put in the effort, you can master it and use Python for many tasks. In this noisy era, many technologies or concepts will … Read more
In today’s internet era, the interaction and acquisition of data have become extremely important. Whether it is scraping information from web pages or interacting with various APIs for data exchange, HTTP requests are indispensable. The Python <span>Requests</span> library is a powerful assistant for handling HTTP requests, greatly simplifying operations related to the HTTP protocol, allowing … Read more
Introduction In this age of information explosion, data has become one of the most valuable resources. Python web scraping, as an efficient technique for acquiring web data, is becoming increasingly important. Today, I will guide you to learn Python web scraping from scratch, making it easy for even programming novices to get started! 1. Basic … Read more