python类open()的实例源码

apply_bpe.py 文件源码 项目:nmtrain 作者: philip30 项目源码 文件源码 阅读 29 收藏 0 点赞 0 评论 0
def __init__(self, codes, separator='@@'):            

        with codecs.open(codes.name, encoding='utf-8') as codes:
            self.bpe_codes = [tuple(item.split()) for item in codes]

        # some hacking to deal with duplicates (only consider first instance)
        self.bpe_codes = dict([(code,i) for (i,code) in reversed(list(enumerate(self.bpe_codes)))])

        self.separator = separator


问题


面经


文章

微信
公众号

扫码关注公众号