BigData: All content tagged as BigData in NoSQL databases and polyglot persistence
For Cloudera, the first vendor to offer a Hadoop distribution, the answer is an unequivocal yes. Last November, Cloudera finally exposed its true sentiments by introducing the Enterprise Data Hub in which Hadoop replaces the data warehouse, among other things, as the center of an organization’s data management strategy. In contrast, Hortonworks takes a hybrid approach, partnering with leading commercial data management and analytics vendors to create a data environment that blends the best of Hadoop and commercial software. In short, Cloudera offers revolution, Hortonworks evolution.
You know what? Both are right. To replace existing enterprise data warehouse, the first step is in cohabiting with them.
Original title and link: Does Hadoop replace or augment the enterprise data warehouse? ( ©myNoSQL)
In my post about in-memory databases vs Aster Data and Greenplum vs Hadoop market share, I’ve proposed a scenario in which Aster Data and Greenplum could expand into the space of in-memory databases by employing hybrid storage.
What I haven’t covered in that post is the possibility of Hadoop, actually HDFS, expanding into hybrid storage.
But that’s happening already and Hortonworks is already working on introducing support for heterogeneous storages in HDFS:
We plan to introduce the idea of Storage Preferences for files. A Storage Preference is a hint to HDFS specifying how the application would like block replicas for the given file to be placed. Initially the Storage Preference will include:
- The desired number of file replicas (also called the replication factor) and;
- The target storage type for the replicas.
Even if the costs of memory will continue to decrease at the same rate as before 2012, when they flat-lined, a cost effective architecture will almost always rely on hybrid storage.
Original title and link: Heterogeneous storages in HDFS ( ©myNoSQL)