Executing Pig on another framework
I understand that Pig Latin is a data flow language. In that sense it should be theoretically possible to execute Pig Latin in any framework though currently and it is meant to be executed in a Hadoop enviornment. How hard would it be to switch Pig Latin to run on a different framework? Are there any extension points for this if at all or is开发者_StackOverflow中文版 Pig Latin is tightly coupled to Hadoop?
PigLatin is tightly coupled to Hadoop. Basically, the PigLatin script is interpreted into a series of Hadoop MapReduce jobs and there isn't really much way of swapping out that underlying data computation layer.
You can write a custom loader and custom writer to load from and store to custom data stores, but in the end it is still starting a Hadoop MapReduce job.
精彩评论