running hadoop on Google app engine?

Is it possible to run map reduce jobs on Google app engine?

Any reference or tu开发者_如何转开发torial would help

Thanks

Sort of.

You can't use the actual MapReduce framework - the architecture is too incompatible with AppEngine.

However, there is an equivalent system built specficially for GAE - appengine-mapreduce. That site is a bit confusing, as the first version of the code only supported mappers, without the subsequent reduce step - recently they released a version with full mapreduce support, but some of the documentation still referes to the earlier mapper-only one.

The best introduction is the GoogleIO talk from Mike Aizatskyi.

You cannot run Hadoop on Appengine (No filesystem access as well).

You may want to check AWS ElasticMapreduce. Its a cloud based platform for running Mapreduce jobs.

ElasticMapreduce

Here is the full documentation: https://developers.google.com/appengine/docs/python/dataprocessing/overview

Saw this Google Cloud Platform advertisement:
Hadoop on Google Compute Engine virtual machines
https://cloud.google.com/solutions/hadoop