machine-learning

Deploying a scikit-learn classifier to production

Apr 4, 2016 sklearn scikit-learn ml machine learning python

Scikit-learn is a great python library for all sorts of machine learning algorithms, and really well documented for the model development side of things. But once you have a trained classifier and are ready to run it in production, how do you go about doing this? There’s a few managed services that will do it for …

Finding related searches with Spark

Nov 19, 2013 spark related searches co-occurrence machine learning scala

Unsupervised learning from user behaviour When a user navigates a site they leave a valuable trail of information - what their first search was, what they followed this search with, and so on. Using this data we can learn related searches automatically by co-occurrence counting. This post takes you through the steps to …

A duplicate classifier using elasticsearch

Aug 20, 2012 elasticsearch machine-learning

Frequently with search based, big data projects the problem of content duplication is an obstacle to having a clean data source. Here’s an approach to improving the data quality by training a classifier to spot duplicates. The Problem The data set has about 470,000 non-unique hotel descriptions (e.g. name, …