bilibili_player.py 文件源码

python
阅读 26 收藏 0 点赞 0 评论 0

项目:multimedia_crawler 作者: JFluo2011 项目源码 文件源码
def parse_video(self, response):
        item = response.meta['item']
        url = 'https://interface.bilibili.com/playurl'
        if not self.__get_json(response):
            return
        try:
            item['info']['play_count'] = self.json_data['play']
            item['info']['intro'] = self.json_data['description']
            item['info']['date'] = self.json_data['created_at']
            item['info']['author'] = self.json_data['author']
        except:
            pass

        try:
            cid = self.json_data['list'][0]['cid']
        except Exception as err:
            self.logger.error('url: {}, error: {}'.format(self.page_url, str(err)))
            return

        params = self.bilibili_common.get_params(cid)
        yield scrapy.FormRequest(url=url, method='GET', meta={'item': item},
                                 formdata=params, callback=self.parse_video_urls)
评论列表
文章目录


问题


面经


文章

微信
公众号

扫码关注公众号