tests_offline.py 文件源码

python
阅读 20 收藏 0 点赞 0 评论 0

项目:scrapy-cluster 作者: WalnutATiie 项目源码 文件源码
def do_test(self, meta_object,
                            text, expected_raw, expected_requests):
        request = Request(url='http://www.drudgereport.com',
                        meta=meta_object)
        response = HtmlResponse('drudge.url', body=text, request=request)

        raw_item_count = 0
        request_count = 0

        for x in self.spider.parse(response):
            if isinstance(x, RawResponseItem):
                raw_item_count = raw_item_count + 1
            elif isinstance(x, Request):
                request_count = request_count + 1

        self.assertEqual(raw_item_count, expected_raw)
        self.assertEqual(request_count, expected_requests)
评论列表
文章目录


问题


面经


文章

微信
公众号

扫码关注公众号