i am working with hadoop 19 on opensuse linux, i am not using any cluster rather running my hadoop code on my machine itself. i am following the standard technique on putting in开发者_如何学运维 distr
I want to merge 2 bzip2\'ed files. I tried appending one to another: cat file1.bzip2 file2.bzip2 > out.bzip2 which seems to work (this file decompressed correctly), but I want to use this file as a
I\'m trying to use Dumbo/Hadoop to calculate TF-IDF for a bunch of small text files using this example http://dumbotics.com/2009/05/17/tf-idf-revisited/
I have a massive amount of input data (that\'s why I use Hadoop) and there are multiple tasks that can be solved with various MapReduce steps of which the first mapper needs all the data as input.
I\'m working with a team of mine on a small application that takes a lot of input (logfiles of a day) and produces useful output after several (now 4, in the future perhaps 10) map-reduce steps (Hadoo
On some websites (like in this PDF : http://sortbenchmark.org/Yahoo2009.pdf) I see very nice graphs that visualize what an Hadoop cluster is doing at what moment.
I\'m trying to implement the following graph reduction algorithm in The graph is an undirected weighted graph
Customers able to upload urls in any time to database and application should processes urls as soon as possible. So i need periodic hadoop jobs running or run hadoop job automatically from other appli
I would like to know what yours Hadoop development environment looks like? Do you deploy jars to test cluster, or run jars in local mode?
I\'m beginning to learn some Hadoop/MapReduce, coming开发者_运维知识库 mostly from a PHP background, with a little bit of Java and Python.
加载中,请稍侯......