MapR: All content tagged as MapR in NoSQL databases and polyglot persistence
HPCC Systems 4 nodes cluster sorts 100 gigabytes in 98 seconds and is 25% faster than a 20 nodes Hadoop cluster.
Results achieved in December 2011 show that an HPCC Systems four node Thor cluster took only 98 seconds to complete a Terasort with a job size of 100 gigabytes (GB) on a cluster five times smaller than Hadoop. The HPCC Systems four node cluster was comprised of one (1) Dell PowerEdge C6100 2U server with Intel® Xeon® processors E5675 series, 48GB of memory, and 6 x 146GB SAS HDD’s. The Dell C6100 houses four nodes inside the 2U enclosure. The previous leader ran the same Terasort benchmark in 130 seconds on a 20-node Hadoop cluster using equivalent node hardware. HPCC Systems is an Open Source, enterprise-proven Big Data analytics-processing platform.
Thus Armando Escalante (SVP and CTO of LexisNexis Risk Solutions and head of HPCC Systems) concludes:
These results demonstrate that HPCC Systems is a leader in Big Data processing
Now switching to a post on MapR’s blog:
Recently a world record was claimed for a Hadoop benchmark. […] We were surprised to see that this world record was for a TeraSort benchmark on a 100GB of data. TeraSort is a standard benchmark and the name is derived from “sorting a terabyte”. Any record claims for sorting a 100GB dataset across a 20 node cluster with 10 times as much memory is comical. The test is named TeraSort not GigaSort.
Original title and link: Hadoop, HPCC, MapR and the TeraSort Benchmark ( ©myNoSQL)
Hortonworks Data Platform, powered by Apache Hadoop — As we began to interact with enterprises and ecosystem partners, the one constant was the need for a base distribution of Apache Hadoop that is 100% open source and that contains the essential components used with every Hadoop installation. A distribution was needed to provide an easy to install, tightly integrated and well tested set of servers and tools. As we interacted with potential partners, we also heard the message loud and clear that they wanted open and secure APIs to easily integrate and extend Hadoop. We believe we have succeeded on both fronts. The Hortonworks Data Platform is such an open source distribution. It is powered by Apache Hadoop and includes the essential Hadoop components, plus some that make it more manageable, open and extensible. Our distribution is based on Hadoop 0.20.205, the first Apache Hadoop release that supports security and HBase. It also includes some new APIs, such as WebHDFS and those in Ambari and HCatalog, which will make it easy for our partners to integrate their products with Apache Hadoop. For those new to Ambari, it is an open source Apache project that will bring improved installation and management to Hadoop. HCatalog is a metadata management service for simplifying the sharing of data between Hadoop and other data systems. We are releasing Hortonworks Data Platform initially as a limited technology preview with plans to open it up to the public in early 2012.
The fight is on–even if for now the tone is still polite. And if we are adding to the mix MapR and LexisNexis’ HPCC, not to mention the armies of marketers and sales coming from Oracle, IBM, EMC, NetApp, etc. this actually smells like war.
Edward Ribeiro apty commented: “This reminds me of Linux distros war circa 2001”.
The emphasis in the text is mine to underline the most important aspects of the announcement. ↩
Original title and link: Hortonworks Data Platform: Hortonworks’ Hadoop Distribution ( ©myNoSQL)
We’ve already heard of MapR’s positioning as a Cloudera competitor for providing a friendly Hadoop distribution. But it was just another company among the many others trying to get into the Big Data with Hadoop space.
MapR goal sounds very similar to Cloudera’s: providing a tweaked enterprise friendly Hadoop distribution. But this round of funding, amounting to $20 million which places it close the Cloudera’s last round of funding of $25 million, comes as a confirmation from the VC space of this business model.
Here’s a quote from a VentureBean post covering this news:
MapR’s software takes Hadoop and makes it safer and more efficient for enterprises to use. It does this providing support for Linux HA, support for random read/write storage (or the ability to overwrite data) and a native network framework system. The NFS was created by running Hadoop on top of MapR’s storage system, as opposed to Linux.
If we are adding to this Yahoo’s spinoff focused on Hadoop, HortonWorks, I think it’s quite safe to conclude that we will see a lot of interesting things happening faster in the Hadoop world.
Original title and link: MapR Raises $20m for Friendly Hadoop Distribution ( ©myNoSQL)