Tag：Reptile
-
Time：2020-3-31
This article will not cover the specific operation of Kafka, but tell you what Kafka is and what important role it can play in reptile development. A simple need Suppose we need to write a micro blog crawler, and the requirements given by the boss are as follows: It’s very easy for you to develop […]
-
Time：2020-3-18
Go language crawls pictures Note: the pages in the code can be crawled normally if the dynamically loaded pages cannot be crawled or the images are afraid of error package main import ( “fmt” “io” “net/http” “os” “regexp” “strconv” _ “strings” ) func SaveImg(idx int, url string, page chan int) { Path: = “D:/gogogo/src/go- Crawler […]
-
Time：2020-3-15
Take a look at what you like and form a good habit Python version 3.8.0, development tool: pycharm Words written in the front So far, you should have known three basic sections of a reptile: Principle and process of reptile Two ways to implement crawler Parsing the source code of web page through beautiful soup […]
-
Time：2020-3-9
Preface The text and pictures of the article are from the Internet, only for learning and communication, and do not have any commercial use. The copyright belongs to the original author. If you have any questions, please contact us in time for handling. By weixinscrm PS: if you need Python learning materials, you can click […]
-
Time：2020-3-3
Python is a very simple, easy to learn and use programming language with powerful functions. It has rich and powerful libraries and high development efficiency. What Python crawlers can do 80% of the world’s reptiles are developed based on python. Learning reptile skills well can provide important data sources for subsequent big data analysis, mining, […]
-
Time：2020-3-2
[Mazu collection] Python crawler Appstore application review data capture For the needs of students’ customers, their boss arranged to catch the comments and semantic analysis of an app on the app store to judge the experience of using the appThe app store actually has an open API interface, but there are so many restrictions that […]
-
Time：2020-2-28
background During the double 11, in order to store some tins of cat litter for my master, I kept brushing the car stickers of Douban love cat group and playing cod 16 while brushing them. As a result, I missed a lot of luxury cars and the game KD dropped a lot. After that, I […]
-
Time：2020-2-25
Since its launch, ufqinews has been continuously updated, optimized and upgraded. As an information application that brings a new news reading experience, ufqinews has become increasingly mature and its browsing volume is also increasing. Recently, the upgrade and improvement of ufqinews include the following aspects. 1. UI adjustment and optimization, clear and easy to read […]
-
Time：2020-2-24
Module installation Windows To install the script, you need to install the dependent environment twisted, which in turn needs to install the C + + dependent environment If twisted error occurs during PIP install sweep Download the corresponding twisted version file at https://www.lfd.uci.edu/ ~ gohlke/pythonlibs/ (cp36 stands for python3.6 version) Then CMD goes to the […]
-
Time：2020-2-23
Using the flash ﹣ apscheduler to do the scheduled cycle task I’m a beginner, rightflaskIt’s strange. I can’t understand the articles I found on the Internet. It’s embarrassing.The original intention is to monitor the number of points exchanged and signed by Guangfa’s DIY credit card. The captured margin is sent to the group through the […]
-
Time：2020-2-21
Today, an open-source project of Baidu cloud disk crawler was launched. The address is https://github.com/callmelanmao/yunshare. Baidu cloud sharing reptile project There are several such open-source projects on GitHub, but they only provide the crawler part. This project also adds the module of saving data and establishing elastic search index based on the crawler, which can […]
-
Time：2020-2-20
1. Preface I haven’t written for a long time. I’ve been working on some interesting technologies using Python recently. I thought it would take some time. Who knows that I didn’t study it deliberately after the first day of introduction. Here are some key points. If I go to learn a language not because it’s […]
