NoSQL Benchmarks NoSQL use cases NoSQL Videos NoSQL Hybrid Solutions NoSQL Presentations Big Data Hadoop MapReduce Pig Hive Flume Oozie Sqoop HDFS ZooKeeper Cascading Cascalog BigTable Cassandra HBase Hypertable Couchbase CouchDB MongoDB OrientDB RavenDB Jackrabbit Terrastore Amazon DynamoDB Redis Riak Project Voldemort Tokyo Cabinet Kyoto Cabinet memcached Amazon SimpleDB Datomic MemcacheDB M/DB GT.M Amazon Dynamo Dynomite Mnesia Yahoo! PNUTS/Sherpa Neo4j InfoGrid Sones GraphDB InfiniteGraph AllegroGraph MarkLogic Clustrix CouchDB Case Studies MongoDB Case Studies NoSQL at Adobe NoSQL at Facebook NoSQL at Twitter



nosql:eu - Second day

The 2nd day at nosql:eu is over. It is time to review the great twits from the 1st day, the slides from the 1st day presentations and the great twits below.

For those of us that haven’t made it to ☞ nosql:eu conference I’ve extracted below some (hopefully most) of the most interesting twits from the conference. I’ve also post slides of the presentations as these are coming.

nosql:eu quotes

Check also the best twits from 1st day @ nosql:eu

  • kevinweil: Modifying my talk in realtime for #nosqleu. Adding Cassandra, HBase, FlockDB to already existing discussion of Scribe, Hadoop, Pig.
  • emileifrem: Cassandra is simply the best in its category. Check out @spyced’s latest deck: #nosql #nosqleu
  • maslett: RT @natishalom: @maslett with the planned support for memcache - gigaspaces turns memcache to a real NoSQL alternative IMO #nosqleu

    Note: personally I’d find that quite confusing. If Gigaspaces is not anymore an elastic cache, then what is it?

  • danharvey: #nosqleu question for today: how do you backup casandra / HBase for user/dev errors? The failure back up is built in.
  • Werner: Arrived at #nosqleu for the first presentation of the day.
  • awhitehouse: @werner We should challenge assumptions that DB partitioning papers make; sometimes smallest possibilities are treated as reality. #nosqleu
  • AndySeaborn: #nosqleu ☞
  • awhitehouse: @werner: We should all read “The 1995 SQL Reunion: People, Project, and Politics” ☞ #nosqleu
  • AndySeaborne: #nosqleu ☞
  • tlossen: “in real systems, there are no corners to cut” — werner vogels about the importance of occam’s razor in systems design #nosqleu
  • hungryblank: RT @tlossen: “in real systems, there are no corners to cut” — werner vogels about the importance of occam’s razor in systems design #nosqleu
  • matwall: @Werner #nosqleu nosql is about choice, not a fight between SQL and new tech.
  • tlossen: “you should all read the multics book” — werner vogels #nosqleu
  • martinbtt: #nosqleu @Werner “on the birth of dynamo”
  • tlossen: “real systems are pretty nasty things” — werner vogels #nosqleu
  • tlossen: “scaling amazon was all about the database, every year scaling out, scaling out ….” — werner vogels #nosqleu
  • tlossen: “scalability, availability, performance, cost-effectiveness are all in the end dominated by data management” — werner vogels #nosqleu
  • martinbtt: “The Amazon homepage is constructed by 200-300 different web services”. #Werner #soa #nosqleu
  • maslett: Amazon CTO @werner: “It all comes down to data management… that’s where the scalability is… that’s where most of the costs are” #nosqleu
  • tlossen: “i HATE eventual consistenty” — werner vogels #nosqleu
  • maslett: .@werner: “What we all want is strongly consistent systems - this eventual consistency stuff is a compromise.” #nosqleu
  • tlossen: “your customers will ALWAYS use your system in a way you did not expect” — werner vogels #nosqleu #dynamo
  • mfiguiere: #nosqleu Werner Vogels: “Customer put something in the shopping cart, they are about to give you money, that should ALWAYS works !”
  • monkchips: “In 2004 we felt we could no longer rely on commercial [relational] systems to operate at Amazon scale”. @werner vogels Amazon CTO, #nosqleu
  • buzzkills: “there were no comercial systems that could support amaon’s scale” [for many of their use cases] @Werner #nosqleu
  • tlossen: “at scale, ALL of this shit happens” — werner vogels on datacenter SNAFUs like flooding from the roof down etc. #nosqleu
  • tlossen: “scaling amazon = upgrading cessna to 747 in mid-flight” — werner vogels #nosqleu
  • tlossen: “object storage is FOREVER” — werner vogels on data outliving software #nosqleu
  • tlossen: “don’t forget, hardward LIES to you!” — werner vogels #nosqleu
  • awhitehouse: @werner: “Economies of scale are mostly about people” (and the knowledge they need to run your system) #nosqleu
  • tlossen: “we really have to dive deep and understand all the problems from top to bottom” - werner vogels on INTELLECTUAL economies of scale #nosqleu
  • beobal: “economies of scale are not just about technologies, it has a lot to do with people” @werner #nosqleu
  • tlossen: “transparency is EVIL” — werner vogels about NFS etc. #nosqleu
  • tlossen: “remember that storage is a very long-lasting relationship” — werner vogels #nosqleu
  • maslett: .@werner: “We shouldn’t all be doing this.” #nosqleu Companies should be focused on their business, not their databases.
  • simonw: Werner Vogels: “S3 is a better key/value store than Dynamo” (due to list/prefix operators) #nosqleu
  • tlossen: “if you keep your system simple, it drives simplicity at the customer side as well” — werner vogels on importance of occam’s razor #nosqleu
  • awhitehouse: “Simplicity needs to happen at the interface” … the API to your system drives the architecture @werner at #nosqleu
  • seanparsons : @Werner’s talk at #nosqleu was illuminating about the focus on managing interaction between systems.
  • CooperDino : WernerVogels at #NoSQLeu: When u do trillions of ops per day even the slightest probability becomes reality
  • martinbtt : Fantastic talk by @Werner at #nosqleu - loads of useful tech nuggets to take away. Great start to the day so far.
  • CooperDino : WernerVogels at #NoSQLeu: Bruce Lindsay & Jim Gray are our heroes, we should all read about their data sys work in the 70s
  • CooperDino : @Werner at #NoSQLeu: Last time Amazon was down was 2004 & it was related to an RDB crashing
  • CooperDino : @Werner at #NoSQLeu: 70% of storage operations in Amazon are key/value
  • CooperDino : WernerVogels at #NoSQLeu: If u have2 jump thru lots of hoops 2use any DB then it prob wrong choice. #JOOB is fresh choice4 #dotNet
  • CooperDino : @Werner at #NoSQLeu: Customers will not look at a DB in isolation, they will always look at where it sits in big picture
  • matwall : Head buzzing from inspiring talk from @werner at #nosqleu
  • monkchips : now @kevinweil (twitter’s analytics lead) presents via skype video… just showed us some very dark twitter offices ;-) #nosqleu
  • awhitehouse : Big hand to @kevinweil for giving his talk from Twitter HQ at 3am local time. #nosqleu
  • matwall : @kevinweil say twitter increase userbase by 300K per day, generate 7Tb of data *per day* #nosqleu
  • buzzkills : Twitter gave up on syslog because it didn’t scale #nosqleu
  • thobe : This is me contributing to the 300GB of twitter data generated while @kevinweil talk about it on #nosqleu
  • tlossen : “you write log lines — scribe does the rest” — kevin weill about logging at scale #nosqleu
  • buzzkills : @buzzkills apparently faceyb wrote scribe, Twitter are big contris #nosqleu (thx to @ianmeyers for correction)
  • matwall : @kevinweil from Twitter describing their Scribe -> Hadoop -> Pig pipeline for data alanysis at #nosqleu Very interesting, I want one.
  • tlossen : “want less java in your life? use pig!” — kevin weill, giving advice on hadoop #nosqleu
  • matwall : @kevinweill on datamining user data: It’s easy to answer questions, it’s hard to ask the right questions. #nosqleu
  • wwwicked : Loving the simplicity of a Pig script versus the equivalent Hadoop/Java code #nosqleu
  • beobal : “value the system that promotes innovation, iteration” @kevinweil #nosqleu
  • monkchips : facebook’s scribe at master - GitHub ☞ a logging system for client performance data, also used by twitter. #nosqleu
  • awhitehouse : @kevinweil: Twitter does most of its data analysis in Pig - scripts can call user-defined functions coded in Java (v. powerful) #nosqleu
  • matwall : Twitter using Apache Mahout coupled with Pig for machine learning when examining user behaviour #nosqleu
  • andrewgarner : Totally sold on Pig #nosqleu
  • wwwicked : A friend of mine said “NoSQL is retarded”. The more I’ve heard over the past 2 days, more more I realise he’s wildly wrong #nosqleu
  • emileifrem : @wwwicked Term is retarded. Notion all RDBMSes will be replaced is retarded. That we’re heading to a polyglot persistence era isnt. #nosqleu
  • monkchips : “we’re trying to move all tweets to Cassandra”. @kevinweil Twitter #nosqleu

    Note: You can read the whole story in myNoSQL exclusive Cassandra @ Twitter: And interview with Ryan King

  • tlossen : “better eventual consistency than POTENTIAL consistency” — kevin weil on reasons to use cassandra at twitter #nosqleu
  • maslett : Twitter is working with Digg to create real-time analytics for Cassandra. Plans to open source. #nosqleu
  • msk_y : RT @buzzkills: Twitter store their log files in Lzo compressed, protocol buffers format on hdfs #nosqleu
  • kingsleydavies : #nosqleu CouchDB used at BBC - typically used as a KVS and is used in iPlayer and parts of the homepage…
  • tlossen : “you can throw rocks and stones at it, and it just keeps going” — enda farrell (bbc) about robustness of couchdb #nosqleu
  • matwall : @endafarrell CouchDb restarts in < 1sec. Occasionally restart in production as restarts are far less than TCP timeout! #nosqleu
  • tlossen : enda farrell shared a neat idea: “pre-sharding” — running 4 instances of couchdb on every node [couchdb @ bbc talk] #nosqleu
  • matwall : @endafarrell “Having things that just work and are simple from the users perspective is brilliant” #nosqleu
  • CooperDino : #NoSQLeu: BBC web site handles 200m requests per day on 1.5TB of data using 8 servers & #CouchDB
  • monkchips : exciting! presentation at #nosqleu from Comcast chief engineer @jon_moore : Why Big Enterprises Are Interested in NoSQL
  • matwall : Agree with @jon_moore at #nosqleu : storage is a means to a business end, nosql contains intrinsic risk
  • benoitc : idealized api of comcast looks like the #couchdb one get,post, get _views #nosqleu
  • matwall : @jon_moore at #nosqleu Can I add more capacity without adding too many more sysadmins? Can my admins work 9-5?
  • matwall : @jon_moore at #nosqleu Is there a company behind product to provide operational support? Important for commoditization
  • monkchips : surprising requirement of the #nosqleu conference. NoSQL providers take note: Enterprises expect JMX support. java ain’t dead. devops?
  • wwwicked : #nosqleu @jon_moore made a fair point re: my comment about analytics on KV stores; may not be best idea but “they” will want to do it anyway
  • timanglade : Totally awesome break-down of the CAP theorem (in the context of Multiple Datacenters) by the amazing @jon_moore. Refreshingly enlightening.
  • kingsleydavies : loving the name *Tokyo Tyrant* and a great, upbeat start to @makoto_inoue preso… #nosqleu
  • matwall : @makato_inoue Says that @al3xandu’s site myNoSL is like “Hello magazine for nosql” :) #nosqleu
  • matwall : Can we have a 3 hour workshop with @makato_inoue please? He’s great! #nosqleu
  • kingsleydavies : +1 yeah… I fear we wont have enough time :-( RT @matwall: Can we have a 3 hour workshop with @makato_inoue please? He’s great! #nosqleu
  • maslett : great presentation on the highly random world of Tokyo Cabinet/Tyrant by @makoto_inoue #nosqleu
  • maslett : Quote of the day: “myNoSQL is the Hello magazine of NoSQL" #nosqleu
  • michaeltiberg : #nosqleu conference is to an end - attendees seems to be satisfied and that makes my day

Check also the best twits from 1st day @ nosql:eu

nosql:eu presentations

Check also the nosql:eu presentations from 1st day

On the Birth of Dynamo - Werner Vogels

Nothing here yet :-(.

Twitter’s use of Cassandra, Pig and HBase - Kevin Weil

Slides from Kevin Weil (@kevinweil) presentation on Twitter’s use of Cassandra, Pig and HBase

CouchDB at the BBC - Enda Farrell

Nothing here yet :(

Why Big Enterprises are Interested in NoSQL - Jon Moore

Slides from Jon Moore (@jon_moore) presentation: Why Big Enterprises are Interested in NoSQL

Memory as the New Disk: Why Redis Rocks - Tim Lossen

Slides from Tim Lossen (@tlossen): Memory as the New Disk: Why Redis Rocks

Tokyo Cabinet, Tokyo Tyrant and Kyoto Cabinet - Makoto Inoue

Nothing here yet :(

Notes from the field: NoSQL tools in Production - Matthew Ford

Slides from Matthew Ford (@matthewcford) Notes from the field: NoSQL tools in Production presentation

nosql:eu live twitter stream

fetching nosql:eu…

Check also the nosql:eu presentations from 1st day