ALL COVERED TOPICS

NoSQL Benchmarks NoSQL use cases NoSQL Videos NoSQL Hybrid Solutions NoSQL Presentations Big Data Hadoop MapReduce Pig Hive Flume Oozie Sqoop HDFS ZooKeeper Cascading Cascalog BigTable Cassandra HBase Hypertable Couchbase CouchDB MongoDB OrientDB RavenDB Jackrabbit Terrastore Amazon DynamoDB Redis Riak Project Voldemort Tokyo Cabinet Kyoto Cabinet memcached Amazon SimpleDB Datomic MemcacheDB M/DB GT.M Amazon Dynamo Dynomite Mnesia Yahoo! PNUTS/Sherpa Neo4j InfoGrid Sones GraphDB InfiniteGraph AllegroGraph MarkLogic Clustrix CouchDB Case Studies MongoDB Case Studies NoSQL at Adobe NoSQL at Facebook NoSQL at Twitter

NAVIGATE MAIN CATEGORIES

Close

Hadoop YARN - Beyond MapReduce

In a conversation with Curt Monash, Arun Murthy (Hortonworks) explains what YARN (aka Hadoop MapReduce 2.0 or MRv2) is about:

YARN, as an aspect of Hadoop, has two major kinds of benefits:

  1. The ability to use programming frameworks other than MapReduce.
  2. Scalability, no matter what programming framework you use.

[…]

The central goal of YARN is to clearly separate two things that are unfortunately smushed together in current Hadoop, specifically in (mainly) JobTracker:

  • Monitoring the status of the cluster with respect to which nodes have which resources available. Under YARN, this will be global.
  • Managing the parallelization execution of any specific job. Under YARN, this will be done separately for each job.

Original title and link: Hadoop YARN - Beyond MapReduce (NoSQL database©myNoSQL)

via: http://www.dbms2.com/2012/07/23/hadoop-yarn-beyond-mapreduce/