web spider built by puppeteer, support task-queue and task-scheduling by decorators,support nedb / mongodb, support data visualization; 基于puppeteer的web爬虫框架,提供灵活的任务队列管理调度方案,提供便捷的数据保存方案(nedb/mongodb),提供数据可视化和用户交互的实现方案
nodejs crawler angular node typescript spider mongodb cheerio proxy headless nedb task-queue node-spider puppeteer nodejs-spider task-scheduling
-
Updated
Dec 10, 2021 - TypeScript