Blog Archives

Platform Performance Gains with Arista Switches

In late 2012 I wrote about the migration of our [DataSift.com's] Hadoop cluster to Arista switches but what I didn’t mention was that we also moved our real time systems over to Arista too. Within the LAN During our fact

Posted in Big Data, Datacenter, NAMOS, Networks

Big Data – Bigger Networking

One of the really attractive aspects of working at a start-up like DataSift is managing the challenges that come with the rapidity of organic growth. Our experiences with the networking aspects of Hadoop are an excellent example of this. When

Tagged with: , , , ,
Posted in Big Data, Datacenter, Networks, Systems

Big Data Monitoring Meets a Little Android

This was originally posted on the Zenoss Community Blog. The DataSift platform consumes, processes, filters, stores and streams terabytes upon terabytes of social data to businesses around the world and we in the Operations team needed to know of any

Posted in Android, Big Data, NAMOS

I build High Availability Platforms so Cloud is not for me

Ever since someone first tried to represent the idea of packet switched network that was resilient to failure they probably used a picture of a cloud. Cisco’s official iconography for such a network is a cloud. It has been taken

Posted in Big Data, Datacenter, Networks, Systems, Virtualization

DataSift Interaction CheatSheet #1:
A Tweet Reply

I’ve recently been working on an open source Android client for the DataSift platform and was subsequently making heavy use of our Developer Documentation site. My notes quickly became this hyperlinked cheatsheet of an example interaction that would show you

Posted in Big Data, NAMOS

Visualising the Twitter firehose with DataSift

In February of 2011 I saw a short video named Immaterials: Light painting WiFi by Timo Arnall, Jørn Knutsen and Einar Sneve Martinussen and something about bringing part of the technical world of bits and bytes, RF and EMR into

Posted in Big Data, Embedded, NAMOS