Emitting a Matrix from a mapper in Hadoop
I am new to Hadoop map reduce, I wanted to know that there is some outputformat type which can allow me to emit a matrix (2d array) directly from the m开发者_如何学运维apper (without converting to 1d).
I plan to include this in my Btech project.
Take a look at: http://hadoop.apache.org/common/docs/current/api/org/apache/hadoop/io/TwoDArrayWritable.html I guess that's what you need.
Yes, You want to emit only a value
as 2D array you can use TwoDArrayWritable
If you need to emit a key
too as matrix- you need to Implement a Custom Writable Class
Hope that you got an idea.
精彩评论