All Questions
Tagged with recordreader hadoop2
3 questions
2
votes
1
answer
716
views
How to create splits from a sequence file in Hadoop?
In Hadoop, I have a sequence file of 3GB size. I want to process it in parallel. Therefore, I am going to create 8 maptasks and hence 8 FileSplits.
FileSplit class has constructors that require the:
...
- 1,164
0
votes
1
answer
135
views
Hadoop 2: Empty result when using custom InputFormat
I want to use a own FileInputFormat with a custom RecordReader to read csv data into <Long><String> pairs.
Therefore I created the class MyTextInputFormat:
import java.io.IOException;
...
- 3,426
0
votes
0
answers
907
views
Hadoop Record Reader only reads first line then input stream seems to be closed
I'm trying to implement a hadoop job, that counts how often a object (Click) appears in a dataset.
Therefore i wrote a custom file input format. The record reader seems to read only the first line of ...
- 29