elasticsearch

Kibana baby kick counter

Apr 29, 2017 kibana elasticsearch

This is part 1 of 2 about using Elasticsearch and Kibana to track patterns in baby activity. Part 2 is on elastic.co. Kicking things off According to countthekicks.org “Counting baby kicks is important because changes in your baby’s movement pattern may indicate potential problems with your pregnancy”. …

Elasticsearch as a smart cache

Feb 18, 2014 elasticsearch caching

A novel use of Elasticsearch in the context of holiday search, not as a traditional store of persistent documents, but as a rolling cache of transient holiday packages. This puts unique demands on Elasticsearch in terms of index and deletion rate, concurrent to a high query rate. Figures below are from February 2014, …

Betting on the Twitter stream with Elasticsearch and Kibana

Jan 19, 2014 twitter sentiment kibana elasticsearch

Sentiment analysis, Elasticsearch and Kibana The idea From the Twitter streaming API grab tweets for a live TV show whilst it’s showing, classify by contestant, analyze sentiment and provide a real-time dashboard into the outlook. Try to predict good bets on the winners. Optional: Gamble. :-) The tools Grabbing …

Scala Future and the Elasticsearch Java API

Nov 16, 2013 scala elasticsearch futures java api

Most examples of the Elasticsearch Java API you’ll have seen follow the prepare/execute/actionGet pattern (in Scala): val response = client.prepareIndex("twitter", "tweet", "1") .setSource(jsonBuilder() .startObject() .field("user", "kimchy") .field("postDate", new …

Spark and Elasticsearch

Nov 12, 2013 spark scala elasticsearch big data

Elastic Sparkle If you work in the Hadoop world and have not yet heard of Spark, drop everything and go check it out. It’s a really powerful, intuitive and fast map/reduce system (and some). Where it beats Hadoop/Pig/Hive hands down is it’s not a massive stack of quirky DSLs built on top of layers of clunky …

Introducing elasticsearch*

Oct 26, 2012 elasticsearch starcluster ec2 cluster computing provisioning plugin cloud

Just opensourced a starcluster plugin for provisioning elasticsearch clusters automatically in the cloud. What is Starcluster? Starcluster is great for spinning up clusters of ec2 nodes quickly for some analytics / data chomping. If you’re not familiar take a look at this very cool screencast: Starcluster and …

A duplicate classifier using elasticsearch

Aug 20, 2012 elasticsearch machine-learning

Frequently with search based, big data projects the problem of content duplication is an obstacle to having a clean data source. Here’s an approach to improving the data quality by training a classifier to spot duplicates. The Problem The data set has about 470,000 non-unique hotel descriptions (e.g. name, …