Using Map/Reduce for Network Forensics and Troubleshooting
Interesting technology stack behind ☞ xtractr — a network packet analysis tool - combining Ferret, SQLLite, V8, jQuery, Flot, Sammy and CouchDB. According to the linked article, xtractr uses a CouchDB inspired MapReduce for performing packet analysis. I’d say that if you could use it, PIG would have been nice too.
One of the huge challenges in packet forensics is that packets have incredibly rich information content and they come at many different layers each of which might be interesting on its own. Now, we didn’t want to build crazy SQL joins (I’m personally JOIN-challenged) across 90,000+ Wireshark fields. So we ended up using Map/Reduce very much inspired by CouchDB.
