使用Node.js和Puppeteer创建Web爬虫
使用Node.js和Puppeteer创建Web爬虫
Node.js HTTP工具
共17Star
详细介绍
Crawler
Web Crawler created with Node.js and Puppeteer to get data from Empiricus newsletter.
Prerequisites
To run this code you need to have Node.js and npm installed.
Installing
After cloning this repository, inside the /crawler folder, run:
$ npm install
Usage
Run:
$ node index.js
License
This project is licensed under the MIT License - see the LICENSE.md file for details
Work in progress
- Reduce the number of times that evaluate method is used
- Change for loop codes for recursion, in order to end the code execution properly, instead of using process.exit() on line 53
-
0 Star
-
0 Star
-
6 Star
-
9 Star
-
0 Star
-
2 Star
-
0 Star
-
0 Star
-
0 Star