Ugly 2GB limit in Tokyo Cabinet
When my hash database was reaching 2GB in size, the datafile would become corrupt. What’s scary is that at that stage, writes to the database seemingly disappeared into the void.
Oops! That’s definitely not something you’d like to see happening with your Tokyo Cabinet. Ugly issue!
via: http://www.supermind.org/blog/554/2gb-limit-with-tokyo-cabinet-aka-invalid-meta-data