test_middleware.py 文件源码

python
阅读 31 收藏 0 点赞 0 评论 0

项目:badoo_scrapy_splash_redis 作者: Supe2015 项目源码 文件源码
def test_adjust_timeout():
    mw = _get_mw()
    req1 = scrapy.Request("http://example.com", meta = {
        'splash': {'args': {'timeout': 60, 'html': 1}},

        # download_timeout is always present,
        # it is set by DownloadTimeoutMiddleware
        'download_timeout': 30,
    })
    req1 = mw.process_request(req1, None)
    assert req1.meta['download_timeout'] > 60

    req2 = scrapy.Request("http://example.com", meta = {
        'splash': {'args': {'html': 1}},
        'download_timeout': 30,
    })
    req2 = mw.process_request(req2, None)
    assert req2.meta['download_timeout'] == 30
评论列表
文章目录


问题


面经


文章

微信
公众号

扫码关注公众号