music.py 文件源码

python
阅读 32 收藏 0 点赞 0 评论 0

项目:MusicSpider 作者: StarkBoLun 项目源码 文件源码
def list_parse(self, response):
        selector = Selector(text=response.body)
        list = selector.xpath("//li//a[@class='msk']/@title")
        urls = selector.xpath("//a[@class='zpgi']/@href").extract()
        start_url = "http://music.163.com"
        for tmp_url in urls:
            yield scrapy.Request(url=start_url + tmp_url, method="GET", callback=self.list_parse,
                                 meta={"cat": response.meta['cat']})
        i = 1
        for tmp in list:
            list_id = selector.xpath("//li[" + str(i)
                                             + "]//a[@class='icon-play f-fr']/@data-res-id").extract_first()
            i = i + 1
            # ????
            yield scrapy.Request(url=start_url+"/playlist?id="+list_id, method="GET", callback=self.play_list_parse,
                                 meta={"cat": response.meta['cat'], "id": list_id})
评论列表
文章目录


问题


面经


文章

微信
公众号

扫码关注公众号