Parallelized grep for Amazon S3

Read More

This produces the most flavoursome, juiciest and succulent chicken. My mouth is still watering. The recipe doesn’t involve much ‘working’ time, but it takes about 3 hours total start to finish. The brining process increases the water and salt content of the chicken through osmosis and denatures the …

Read More

The project Sous-vide on a budget. Build a PID temperature controller for mains (230V) devices. Then any suitable device (slow cooker, rice cooker, hotplate, etc.) can then be plugged in and turned into a highly accurate temperature controlled cooker. Data logging I also wanted remote data logging, so I could see what …

Read More

Just opensourced a starcluster plugin for provisioning elasticsearch clusters automatically in the cloud. What is Starcluster? Starcluster is great for spinning up clusters of ec2 nodes quickly for some analytics / data chomping. If you’re not familiar take a look at this very cool screencast: Starcluster and …

Read More

Due to the recent outage on GoDaddy a lot of people are reconsidering their DNS options. Amazon Route53 is a great option - cheap, flexible and well proven. To migrate you first need to export a zone file for the domain from GoDaddy. It’s been highlighted the zone files are slightly broken in CNAME records, so …

Read More

Frequently with search based, big data projects the problem of content duplication is an obstacle to having a clean data source. Here’s an approach to improving the data quality by training a classifier to spot duplicates. The Problem The data set has about 470,000 non-unique hotel descriptions (e.g. name, …

Read More

Made a screencast (my first!) of iboto to give a demo of the Amazon EC2 multi-account coolness: Incidentally, making screencasts on Linux was a bit of a slog until I found the right tools and workarounds, so that might make the subject of a blog post of its own.

Read More

My house tweets. It speaks. It sends me jabber messages. This seems to be a constant source of amusement for guests. This ‘house of the future’ was built with a small amount of DIY electronics and some software hacking, on a shoestring budget. Over time I’ve added more systems to the house and it is …

Read More

Amazon have launched a neat new Route 53 feature: latency-based routing. The idea behind this is when someone hits www.yoursite.com this resolves to the closest server to them, cutting latency. This DNS cleverness has been used by the big boys for some time, but not been available to us mortals without shelling out big …

Read More

If you’ve used Amazon webservices much at all you’ll probably have come across their DNS service route53. This offers very competitively priced DNS hosting on the Amazon cloud. To install: $ pip install cli53 The first step everyone migrating commonly goes through is getting their existing zones into the …

Read More