mrjob 026
mrjob 026
- Downloads: 265
- Requirements:
- Size:
- Licence:
- Version: mrjob
- Added At: 2011-26-05
- Publisher Site:
mrjob 026
mrjob is a Python module that helps you write and run Hadoop Streaming jobs.mrjob fully supports Amazon's Elastic MapReduce (EMR) service, which allows you to buy time on a Hadoop cluster on an hourly basis. It also works with your own Hadoop cluster.Installation:python setup.py installSetting up EMR on Amazon * create an Amazon Web Services account: http://aws.amazon.com/ * sign up for Elastic MapReduce: http://aws.amazon.com/elasticmapreduce/ * Get your access and secret keys (go to http://aws.amazon.com/account/ and click on "Security Credentials") and set the environment variables $AWS_ACCESS_KEY_ID and $AWS_SECRET_ACCESS_KEY accordinglyTry it out!# locallypython mrjob/examples/mr_word_freq_count.py README.md > counts# on EMRpython mrjob/examples/mr_word_freq_count.py README.md -r emr > counts# on your Hadoop clusterpytho
Soft85 only provide legal software, please help us keeping pur site legal, if you think this page is violating copyrights please let us know by clicking here Here