python: All content on NoSQL databases and projects about python, featuring the best daily NoSQL articles, news, and links on python

Tornado Sees Some NoSQL Activity

by Alex Popescu

Twitter Reddit

Tornado, the non-blocking web server and tools open sourced by FriendFeed before their acquisition, seems to get some NoSQL activity. While Django is leading the way in the Python world, judging by the NoSQL projects happening around Node.js, one could say that Tornado, with its non-blocking architecture, may be an interesting alternative.

Thomas Pelletier has ☞ a blog post about a simple websocket + Tornado + Redis Pub/Sub protocol integration:

The principle is very simple: when your user loads the page, she is automatically added to a list of “listeners”. An independent thread is running: it listens for messages from Redis with the subscribe command, and send a message through Websocket to every registered ”listener”. In this example, the user can send a message to herself with a simple AJAX-powered form, which calls a view with a payload (the message), and the view publish it via the publish command of Redis.

This is basically a web chat! If you want to have fun, you can then add a roster, with a presence system, authentication etc…

There’s also a ☞ GitHub project called Trombi:

Trombi is an asynchronous CouchDB client for Tornado.

And I’m pretty sure there are other projects I’ve missed (but you can leave a comment to add them to the list).

Original title and link for this post: Tornado Sees Some NoSQL Activity (published on the NoSQL blog: myNoSQL)


Presentation: RestMQ - HTTP/Redis based Message Queue

by Alex Popescu

Twitter Reddit

Gleicon Moraes’ slide deck about RestMQ, an HTTP/Redis based message queue. More about RestMQ can be found ☞ here and the source code is available on ☞ GitHub.

Keep in mind that Redis-backed queues is one very often cited use case for Redis.

Original title and link for this post: Presentation: RestMQ - HTTP/Redis based Message Queue (published on the NoSQL blog: myNoSQL)


MapReduce with MongoDB and Python

by Alex Popescu

Twitter Reddit

Complete example of using MongoDB MapReduce with PyMongo:

In this post, I’ll present a demonstration of a map-reduce example with MongoDB and server side JavaScript. Based on the fact that I’ve been working with this technology recently, I thought it would be useful to present here a simple example of how it works and how to integrate with Python.

Original title and link for this post: MapReduce with MongoDB and Python (published on the NoSQL blog: myNoSQL)


MongoDB with Python

by Alex Popescu

Twitter Reddit

Firstly, Diarmuid Bourke’s presentation at PyCon Irland 2010:

Mike Dirolf ☞ covers the details of working with PyMongo and replica sets, one of the most interesting features in the MongoDB 1.6 releases:

PyMongo makes working with replica sets easy. Here we’ll launch a new replica set and show how to handle both initialization and normal connections with PyMongo.

And in case you’d like to learn some more you can also check:

Original title and link for this post: MongoDB with Python (published on the NoSQL blog: myNoSQL)


Django and NoSQL Databases Revisited

by Alex Popescu

Twitter Reddit

Django decided long time ago that Ruby on Rails cannot be the only framework where people can have fun integrating with all NoSQL databases. During this year DjangoCon Europe there were several session dedicated to Django and NoSQL databases:

What NoSQL support in the Django ORM looks like, and how do we get there

Alex Gaynor speaks about what needs to change in Django ORM to make it more NoSQL friendly:

Reinout van Rees has a summary of the talk ☞ here.

Using MongoDB in your app

Peter Bengtsson talks about his experience of passing from using ZODB for the last 10 years to MongoDB

Some notes from the talk are available ☞ here.

Relax your project with CouchDB

Benoît Chesneau talks about what makes CouchDB appealing to python developers. He also covers the CouchDBkit python framework.

Django and Neo4j: Domain Modeling that Kicks Ass

Not coming from DjangoCon, but still about Django and Neo4j, is Tobias Ivarsson’s presentation: “Django and Neo4j - Domain modeling that kicks ass”:

Derek Stainer summarizes the slide deck ☞ here.

Django and NoSQL Panel

A fantastic panel on the future of Django and NoSQL databases that you can watch over ☞ blip.tv. Reinout van Rees published a transcript of the panel ☞ here.

All in all a lot of NoSQL excitement in the Django world! Or should it be the opposite?

Update: Here is the latest Django and NoSQL Databases status update

Django and NoSQL Databases Revisited originally posted on the NoSQL blog: myNoSQL


Gephi: Visualization Library for Graph Databases

by Alex Popescu

Twitter Reddit

You probably know by now that I love visualization tools:

Get the version of Gephi app that can read neo4j databases bzr branch http://bazaar.launchpad.net/~bujacik/gephi/support-for-neo4j:

Gephi and Neo4j

Quick Dive into Hypertable Thrift API

by Alex Popescu

Twitter Reddit

I like the parallels with notions from the MySQL world:

[…] let’s take a look at high performance reading using Scanner. To those who are familiar with MySQL, the concept of using scanner is quite similar to the SSCursor. Instead of reading all the records into client side memory, there is a server-side cursor that’s “streaming” the result set to client side.


Miniredis: Python-based Redis Clone

by Alex Popescu

Twitter Reddit

Benjamin Pollack:

A very tiny clone of Redis, mostly for Windows support


Friendlier CLI frontend for HBase

by Alex Popescu

Twitter Reddit

Going around HBase’s console program and also Thrift interface by using Jython as a CLI frontend:

HBase, the well known non-relational distributed database, comes with a console program to perform various operations on a HBase cluster. I’ve personally found this tool to be a bit limited and I’ve toyed around the idea of writing my own. Since HBase only comes with a Java driver for direct access and the various RPC interfaces such as Thrift don’t offer the full set of functions over HBase, I decided to go for Jython and to directly use the Java API. This article will show a mock-up of such a tool.


Getting started with Redis, Python and YQL

by Alex Popescu

Twitter Reddit
1 likes

A quick intro to Redis by Khashayar showing why he loves Redis, how to install and perform basic operations against Redis and building an RSS-to-Twitter tool with Python, YQL and Redis:

In this code we first use YQL to get the RSS. Then we parse the RSS to get our desired field […]. After that we save these values to our database […]


NoSQL News & Links 2010-04-16

by Alex Popescu

Twitter Reddit
  1. Tarek Ziadé: ☞ A Firefox plugin experiment. XUL, Bottle and Redis
  2. Andreas Jung: ☞ Looking beyond one’s own nose - looking at RabbitMQ and MongoDB

    Unsorted remarks on RabbitMQ and MongoDB plus some benchmarks with mass data

  3. Franck Cuny: ☞ presque, a Redis / Tatsumaki based message queue. Perl and Redis baby!
  4. Mark Atwood: ☞ Reacting to “Memcached is not a store”. IMO, it is as much as a store as any dict/hash you’ve been using. Well, a bit more.
  5. okram: ☞ pipes. A lot of activity around graph databases lately:

    Pipes is a graph-based data flow framework written in Java 1.6+. A process graph (also known as a Kahn process network) is composed of a set of process vertices connected to one another by a set of communication edges. Each process can run independent of the others and as such, concurrency is a natural consequence as data is transformed in a pipelined fashion from input to output.


Redis and Twitter filters in Python or Ruby

by Alex Popescu

Twitter Reddit

Mirko Froehlich has a ☞ long post explaining the problem and the rationale behind the chosen architectures. Then, he goes on presenting the various pieces used in building the solution:

Code is available on ☞ GitHub.

Bulkan Evcimen took this sample application and built it on a Python stack:

So now you have yet another “good” reason[1] to play with Redis and Twitter.

References