Recently, my good friend received a new task, which is to crawl different data sources and extract important information from them.Not long after this task started, a long-standing problem was encountered, that is, the coding of some websites could not be determined, which made it impossible to parse the data.Not to mention the subsequent extraction of information.Due to the tight schedule and heavy task, at his request, he finally decided to use his reptile magic to help him.

.

1. Build a Python environment

   This part of the content is mainly for the convenience of novices, and the veterans can skip it directly.

   First, you need to build a Python environment. The easiest way is to download anaconda from the Tsinghua software mirror site and install it.The official website link of Tsinghua Software Mirror Station is: https://mirrors.tuna.tsinghua.edu.cn

  Click to select anaconda, as shown below: