get_proxy.py 文件源码

python
阅读 22 收藏 0 点赞 0 评论 0

项目:Spider 作者: poluo 项目源码 文件源码
def __init__(self, num, pool_size):
        self.pool_size = pool_size
        res = self.db().find()
        for one in res:
            self.db().remove(one)
        if num == 0:
            self.run_num = 100000
        else:
            self.run_num = num * 2
        self.passed = []
        self.hot = []
        self.cold = []
        self.pending = []
        self.count = 0

        self.s2 = sched.scheduler(time.time, time.sleep)
        self.s2.enter(0, 1, self.get_freeproxy_in_xdaili)
        self.s2.enter(3, 1, self.grasp_proxy)
        self.s2.run()
        self.s1 = sched.scheduler(time.time, time.sleep)
        self.s1.enter(3600, 2, self.regular.clean)
        self.s1.run()
评论列表
文章目录


问题


面经


文章

微信
公众号

扫码关注公众号