Hadoop Cluster Configuration Tips
A set of tips on how to configure a Hadoop cluster in terms of networking, directories and partitioning, backup, replication, compression, resource allocation, memory, job scheduling, logs, plus required configuration options.
Plan to use a centralized configuration management framework once your cluster approaches five nodes. Your approach should include both tools and processes for version control, copying files, and keeping cluster configurations in sync. Plan to use monitoring tools such as Nagios to track the performance and health of systems throughout the cluster.
Adding this to the Hadoop knowledge base list:
- Hadoop hardware recommendations
- Hadoop provisioning and Amdhal’s Law
- Hadoop and HBase capacity planning
Original title and link: Hadoop Cluster Configuration Tips (NoSQL databases © myNoSQL)
via: http://documentation.datameer.com/display/DAS1/Hadoop+Cluster+Configuration+Tips
