HPC: All content tagged as HPC in NoSQL databases and polyglot persistence
Found this great slide showing the fundamental differences between Big Data platforms and HPC in Steve Loughran‘s “My other computer is a datacenter” presentation (embedded at the end):
If there’re just two things to remember about this:
- Big Data is focusing on data, while HPC’s focus is on computing (petabytes vs petaflops)
- Big Data platforms assume failure is inevitable and are architected for it.
Garth Gibson discusses the similaritis and differences between HPC and big data applications in terms of scale of data and challenges.
Most of the time I take filesystems for granted. But that’s exactly what NoSQL database are not doing. Just as a quick example, Basho has designed a special backend for Riak whose main focus is minimizing disk access in order to provide consistent performance.