Introduction Recently, I wrote a web scraper for work to extract information from the National Standards website, which naturally involved Python. When it comes to parsing HTML, XPath undoubtedly stands out as the top weapon. You may have heard of or used other parsing methods, such as Beautiful Soup, which seems to have a lot … Read more
Beautiful Soup Beautiful Soup, as the name suggests, is filled with beauty. It is often abbreviated as bs4 and is an outstanding HTML/XML parsing library for Python. It acts like a skilled craftsman, meticulously transforming chaotic HTML or XML documents into a complex and orderly tree structure, allowing us to navigate, search, and modify the … Read more
Parsel is a lightweight and efficient web data extraction library in the Python ecosystem, developed based on lxml (a high-performance XML/HTML parser). It supports CSS selectors, XPath expressions, and regular expressions, making it flexible for various web data extraction scenarios (either used independently or in conjunction with the Scrapy framework). Advantages 1. Multi-selector support: Compatible … Read more
Basic Concepts of the WWW Overview in One Image As time goes by, we have completed most of our computer course studies, and some students have even finished and entered the review stage. Today, we will deepen our understanding of the basic concepts of the WWW and master the concepts and functions of HTTP, HTML, … Read more
This article is based on practical experience and summarizes the reading and parsing of local HTML files in a Python environment, especially focusing on encoding checks and error issues. Introduction In a Python environment, the most commonly used method for reading local HTML files is the built-in file operation function open().The basic syntax of the … Read more
Click the blue “Most Programmer” to follow me! Add a “star“, every day at 18:03 to learn technology together! Web Technology and HTTP Protocol Table of Contents Domain Name 1. Concept of Domain Name 2. Structure of Domain Name 3. Types of Domain Names 1. Classified by Hierarchy 2. Classified by Purpose 3. Special Types … Read more
I’ve seen someone ask this online, so I would like to share my answer. The person asking further elaborated: If I treat the server’s HTML, CSS, images, etc. as files transferred to the client and then assemble them for display, can I achieve the functionality of a webpage? This is a seemingly simple question that … Read more
1. Web Crawler Architecture 👉 Several important elements of web page writing: 【html】 The full name in Chinese is Hypertext Markup Language, similar to XML format. Hypertext: Refers to images, links, and even non-text elements like music and programs within the page. The structure of HTML includes the “head” part and the “body” part, where … Read more
When we click on a URL and it is displayed in our browser, what exactly happens in the computer and over the network during this process? Server Starts Listening The story actually does not begin when we enter a URL in the browser’s address bar or click on a link; it traces back to when … Read more
Follow 👆 the public account and reply "python" to get the zero-based tutorial! Source from the internet, delete if infringing 1. Correct Understanding of Python Web Scraping Web scraping is a very interesting technology that can be used to obtain things that others cannot access or need to pay for, and it can also automatically … Read more