CDP is the abbreviation of Chrome DevTools Protocol. It provides the ability to interact with the Chrome browser. You can communicate with Chrome through CDP to obtain browser status information, perform operations, etc. Network.Response is a domain (Domain) in CDP, which provides information related to network request responses.
WebSocket is a two-way communication protocol based on the TCP protocol that allows real-time data transfer between the browser and the server. In Python, a WebSocket client can be easily implemented using the websocket-client library
Direct assignment: In fact, it is a reference to the object. Shallow copy (copy): copies the parent object and does not copy the internal child objects of the object. Deep copy (deepcopy): The deepcopy method of the copy module completely copies the parent object and its child objects.
Normally, after the remote connection is closed, windows will enter the standby state and cannot perform interface rendering, so some automated applications will not be able to run. In order to still be able to run the application after the remote connection is closed, you need to use the following method to close the remote desktop
Many people like to use Selenium or Puppeteer (Pyppeteer) to write crawlers by simulating a browser, thinking that this way they can not be detected by the website, and they can crawl whatever data they want
Students who often use Selenium or Puppeteer know that the Chrome browser they start is divided into headed mode and headless mode. When operating on your own computer, if it is in head mode
Why set elements to wait? When your network is slow, it is slow to open the webpage, the webpage is not fully opened, the code is already executing, but the element you locate is not found, and python will report an error at this time
imaplib implements clients for communicating with Internet Message Access Protocol (IMAP) version 4 servers
According to the positioning methods of father and son, brother, and adjacent nodes, many people will encounter the problem that the node they want to locate cannot be directly located in practical applications, and they need to be relatively located through nearby nodes.