middlewares.py 文件源码

python
阅读 30 收藏 0 点赞 0 评论 0

项目:PatentCrawler 作者: will4906 项目源码 文件源码
def process_response(self, request, response, spider):
        if response.status == 200:
            ok = CookieService.checkWholeCookieFromSetCookies(response.headers.getlist('Set-Cookie'))
            if ok is True:
                CookieService.readCookiesFromList(response.headers.getlist('Set-Cookie'))
        if response.status == 302:
            resp = requests.get('http://www.pss-system.gov.cn/sipopublicsearch/patentsearch/tableSearch-showTableSearchIndex.shtml')
            CookieService.cookies = dict_from_cookiejar(resp.cookies)
            print(CookieService.cookies)
            while LoginService(CookieService.cookies).startLogin() is not True:
                pass
            request.cookies = CookieService.cookies
            return self._retry(request, 'unlogin', spider)
        return response
评论列表
文章目录


问题


面经


文章

微信
公众号

扫码关注公众号