ALL COVERED TOPICS

NoSQL Benchmarks NoSQL use cases NoSQL Videos NoSQL Hybrid Solutions NoSQL Presentations Big Data Hadoop MapReduce Pig Hive Flume Oozie Sqoop HDFS ZooKeeper Cascading Cascalog BigTable Cassandra HBase Hypertable Couchbase CouchDB MongoDB OrientDB RavenDB Jackrabbit Terrastore Amazon DynamoDB Redis Riak Project Voldemort Tokyo Cabinet Kyoto Cabinet memcached Amazon SimpleDB Datomic MemcacheDB M/DB GT.M Amazon Dynamo Dynomite Mnesia Yahoo! PNUTS/Sherpa Neo4j InfoGrid Sones GraphDB InfiniteGraph AllegroGraph MarkLogic Clustrix CouchDB Case Studies MongoDB Case Studies NoSQL at Adobe NoSQL at Facebook NoSQL at Twitter

NAVIGATE MAIN CATEGORIES

Close

Y! News: An inside look at rebuilding the largest news site on the web

Handling Yahoo! News data:

All this data is then pushed to a massive NoSQL data grid. A core goal when designing our data grid was the ability to easily attach new information to any existing piece of content. That means any team within Yahoo! can analyze and enhance the content. Yahoo! scientists are currently using technologies such as PIG and Hadoop to do things like find related clusters of news stories to show our users.

That, plus JSON format for handling different content types and a consolidated storage strategy for “quick iterations and continuous innovation”. No mention though on what is the storage engine. PNUTS?

Original title and link: Y! News: An inside look at rebuilding the largest news site on the web (NoSQL databases © myNoSQL)

via: http://developer.yahoo.com/blogs/ydn/posts/2010/11/ynews-an-inside-look-at-rebuilding/