CSVAssignRowIDMapper.java 文件源码

java
阅读 19 收藏 0 点赞 0 评论 0

项目:systemml 作者:
@Override
public void map(LongWritable key, Text value,
        OutputCollector<ByteWritable, OffsetCount> out, Reporter report)
        throws IOException 
{
    if(first) {
        first = false;
        fileOffset = key.get();
        outCache = out;
    }

    //getting the number of colums
    if(key.get()==0 && headerFile) {
        if(!ignoreFirstLine) {
            report.incrCounter(CSVReblockMR.NUM_COLS_IN_MATRIX, outKey.toString(), value.toString().split(delim, -1).length);
            num++;
        }
        else
            realFirstLine = true;
    }
    else {
        if(realFirstLine) {
            report.incrCounter(CSVReblockMR.NUM_COLS_IN_MATRIX, outKey.toString(), value.toString().split(delim, -1).length);
            realFirstLine = false;
        }
        num++;
    }
}
评论列表
文章目录


问题


面经


文章

微信
公众号

扫码关注公众号