python: All content on NoSQL databases and projects about python, featuring the best daily NoSQL articles, news, and links on python
Monday, 30 August 2010
Tornado Sees Some NoSQL Activity
Tornado, the non-blocking web server and tools open sourced by FriendFeed before their acquisition, seems to get some NoSQL activity. While Django is leading the way in the Python world, judging by the NoSQL projects happening around Node.js, one could say that Tornado, with its non-blocking architecture, may be an interesting alternative.
Thomas Pelletier has ☞ a blog post about a simple websocket + Tornado + Redis Pub/Sub protocol integration:
The principle is very simple: when your user loads the page, she is automatically added to a list of “listeners”. An independent thread is running: it listens for messages from Redis with the subscribe command, and send a message through Websocket to every registered ”listener”. In this example, the user can send a message to herself with a simple AJAX-powered form, which calls a view with a payload (the message), and the view publish it via the publish command of Redis.
This is basically a web chat! If you want to have fun, you can then add a roster, with a presence system, authentication etc…
There’s also a ☞ GitHub project called Trombi:
Trombi is an asynchronous CouchDB client for Tornado.
And I’m pretty sure there are other projects I’ve missed (but you can leave a comment to add them to the list).
Original title and link for this post: Tornado Sees Some NoSQL Activity (published on the NoSQL blog: myNoSQL)
Wednesday, 25 August 2010
Presentation: RestMQ - HTTP/Redis based Message Queue
Gleicon Moraes’ slide deck about RestMQ, an HTTP/Redis based message queue. More about RestMQ can be found ☞ here and the source code is available on ☞ GitHub.
Keep in mind that Redis-backed queues is one very often cited use case for Redis.
Original title and link for this post: Presentation: RestMQ - HTTP/Redis based Message Queue (published on the NoSQL blog: myNoSQL)
Tuesday, 24 August 2010
MapReduce with MongoDB and Python ☞
Complete example of using MongoDB MapReduce with PyMongo:
In this post, I’ll present a demonstration of a map-reduce example with MongoDB and server side JavaScript. Based on the fact that I’ve been working with this technology recently, I thought it would be useful to present here a simple example of how it works and how to integrate with Python.
Original title and link for this post: MapReduce with MongoDB and Python (published on the NoSQL blog: myNoSQL)
Friday, 20 August 2010
MongoDB with Python
Firstly, Diarmuid Bourke’s presentation at PyCon Irland 2010:
Mike Dirolf ☞ covers the details of working with PyMongo and replica sets, one of the most interesting features in the MongoDB 1.6 releases:
PyMongo makes working with replica sets easy. Here we’ll launch a new replica set and show how to handle both initialization and normal connections with PyMongo.
And in case you’d like to learn some more you can also check:
Original title and link for this post: MongoDB with Python (published on the NoSQL blog: myNoSQL)
Thursday, 5 August 2010
Django and NoSQL Databases Revisited
Django decided long time ago that Ruby on Rails cannot be the only framework where people can have fun integrating with all NoSQL databases. During this year DjangoCon Europe there were several session dedicated to Django and NoSQL databases:
- Alex Gaynor: What NoSQL support in the Django ORM looks like, and how do we get there
- Peter Bengtsson: Using MongoDB in your app
- Benoît Chesneau: Relax your project with CouchDB
- Tobias Ivarsson: Django and Neo4j: Domain Modeling that Kicks Ass
- Django and NoSQL Panel
What NoSQL support in the Django ORM looks like, and how do we get there
Alex Gaynor speaks about what needs to change in Django ORM to make it more NoSQL friendly:
Reinout van Rees has a summary of the talk ☞ here.
Using MongoDB in your app
Peter Bengtsson talks about his experience of passing from using ZODB for the last 10 years to MongoDB
Some notes from the talk are available ☞ here.
Relax your project with CouchDB
Benoît Chesneau talks about what makes CouchDB appealing to python developers. He also covers the CouchDBkit python framework.
Django and Neo4j: Domain Modeling that Kicks Ass
Not coming from DjangoCon, but still about Django and Neo4j, is Tobias Ivarsson’s presentation: “Django and Neo4j - Domain modeling that kicks ass”:
Derek Stainer summarizes the slide deck ☞ here.
Django and NoSQL Panel
A fantastic panel on the future of Django and NoSQL databases that you can watch over ☞ blip.tv. Reinout van Rees published a transcript of the panel ☞ here.
All in all a lot of NoSQL excitement in the Django world! Or should it be the opposite?
Update: Here is the latest Django and NoSQL Databases status update
Django and NoSQL Databases Revisited originally posted on the NoSQL blog: myNoSQL
Tuesday, 3 August 2010
Gephi: Visualization Library for Graph Databases ☞
You probably know by now that I love visualization tools:
Get the version of Gephi app that can read neo4j databases bzr branch http://bazaar.launchpad.net/~bujacik/gephi/support-for-neo4j:
![]()
Thursday, 29 July 2010
Quick Dive into Hypertable Thrift API ☞
I like the parallels with notions from the MySQL world:
[…] let’s take a look at high performance reading using Scanner. To those who are familiar with MySQL, the concept of using scanner is quite similar to the SSCursor. Instead of reading all the records into client side memory, there is a server-side cursor that’s “streaming” the result set to client side.
Tuesday, 27 July 2010
Miniredis: Python-based Redis Clone ☞
Benjamin Pollack:
A very tiny clone of Redis, mostly for Windows support
Tuesday, 29 June 2010
Friendlier CLI frontend for HBase ☞
Going around HBase’s console program and also Thrift interface by using Jython as a CLI frontend:
HBase, the well known non-relational distributed database, comes with a console program to perform various operations on a HBase cluster. I’ve personally found this tool to be a bit limited and I’ve toyed around the idea of writing my own. Since HBase only comes with a Java driver for direct access and the various RPC interfaces such as Thrift don’t offer the full set of functions over HBase, I decided to go for Jython and to directly use the Java API. This article will show a mock-up of such a tool.
Thursday, 22 April 2010
Getting started with Redis, Python and YQL ☞
A quick intro to Redis by Khashayar showing why he loves Redis, how to install and perform basic operations against Redis and building an RSS-to-Twitter tool with Python, YQL and Redis:
In this code we first use YQL to get the RSS. Then we parse the RSS to get our desired field […]. After that we save these values to our database […]
Friday, 16 April 2010
NoSQL News & Links 2010-04-16
- Tarek Ziadé: ☞ A Firefox plugin experiment. XUL, Bottle and Redis ¶
- Andreas Jung: ☞ Looking beyond one’s own nose - looking at RabbitMQ and MongoDB ¶
Unsorted remarks on RabbitMQ and MongoDB plus some benchmarks with mass data
- Franck Cuny: ☞ presque, a Redis / Tatsumaki based message queue. Perl and Redis baby! ¶
- Mark Atwood: ☞ Reacting to “Memcached is not a store”. IMO, it is as much as a store as any dict/hash you’ve been using. Well, a bit more. ¶
- okram: ☞ pipes. A lot of activity around graph databases lately: ¶
Pipes is a graph-based data flow framework written in Java 1.6+. A process graph (also known as a Kahn process network) is composed of a set of process vertices connected to one another by a set of communication edges. Each process can run independent of the others and as such, concurrency is a natural consequence as data is transformed in a pipelined fashion from input to output.
Wednesday, 31 March 2010
Redis and Twitter filters in Python or Ruby
Mirko Froehlich has a ☞ long post explaining the problem and the rationale behind the chosen architectures. Then, he goes on presenting the various pieces used in building the solution:
- ☞ TweetStream: Ruby library for Twitter streaming API
- Redis used as a queue
- ☞ Sinatra
- ☞ jQuery
- deployment: ☞ nginx + ☞ Passenger + ☞ Capistrano + ☞ God
Code is available on ☞ GitHub.
Bulkan Evcimen took this sample application and built it on a Python stack:
- ☞ tweetstream: Python lib for Twitter streaming API
- Redis over redis-py
- ☞ CherryPy: web app framework. As a side note, there is a Python framework very similar to Sinatra called Bottle
- ☞ Jinja2: HTML templating
- ☞ jQuery
So now you have yet another “good” reason[1] to play with Redis and Twitter.
References
- [1] myNoSQL has previously published: NoSQL Twitter applications and More NoSQL-based Twitter apps. (↩)

