Mathieu Elie - Freelance Consultant http://www.mathieu-elie.net scalable architectures - system admin - programming Mon, 29 Apr 2013 13:17:43 +0000 en-US hourly 1 http://wordpress.org/?v=3.5.1 Simple and usefull monit conf for elasticsearch http://www.mathieu-elie.net/simple-and-usefull-monit-conf-for-elasticsearch/ http://www.mathieu-elie.net/simple-and-usefull-monit-conf-for-elasticsearch/#comments Mon, 29 Apr 2013 13:15:42 +0000 Matt http://www.mathieu-elie.net/?p=2234 Posted in Tech

Getting your elasticsearch cluster running is not so long. But now you have to properly monitor it. It can be down even if the server is still up and even the “java elasticsearch process”. Here is a nice monit conf grab from chef elasticsearch cookbook: check host elasticsearch_connection with address 0.0.0.0   if failed url http://0.0.0.0:9200/ with timeout 15 seconds then alert   group elasticsearch check host elasticsearch_cluster_health with address 0.0.0.0   if failed url http://0.0.0.0:9200/_cluster/health      and content == 'green'      with timeout 60 seconds      then alert   group elasticsearch Will send a mail if the http api not reply and the last but not least will send a mail if the cluster is in another state than green (this is the beggining of the end sometimes ;) ). You have to install this on each node. In my case i run all my node with monit (ping me if you want a 30 seconds monit install on debian like).]]> Posted in Tech

Getting your elasticsearch cluster running is not so long. But now you have to properly monitor it.

It can be down even if the server is still up and even the “java elasticsearch process”.

Here is a nice monit conf grab from chef elasticsearch cookbook:

check host elasticsearch_connection with address 0.0.0.0
  if failed url http://0.0.0.0:9200/ with timeout 15 seconds then alert
  group elasticsearch

check host elasticsearch_cluster_health with address 0.0.0.0
  if failed url http://0.0.0.0:9200/_cluster/health
     and content == 'green'
     with timeout 60 seconds
     then alert
  group elasticsearch

Will send a mail if the http api not reply and the last but not least will send a mail if the cluster is in another state than green (this is the beggining of the end sometimes ;) ).

You have to install this on each node.

In my case i run all my node with monit (ping me if you want a 30 seconds monit install on debian like).

]]> http://www.mathieu-elie.net/simple-and-usefull-monit-conf-for-elasticsearch/feed/ 0 websocket firewall ok on port 80 and subpath on samedomain with haproxy http://www.mathieu-elie.net/websocket-firewall-ok-on-port-80-and-subpath-on-samedomain-with-haproxy/ http://www.mathieu-elie.net/websocket-firewall-ok-on-port-80-and-subpath-on-samedomain-with-haproxy/#comments Mon, 08 Apr 2013 09:56:33 +0000 Matt http://www.mathieu-elie.net/?p=2229 Posted in OnePlaylist Engineering

Websocket are tcp connection independant from your web server / reverseproxy. So they need another tcp port. Its an issue if you are behind a firewall allowing only port 80 and you have only one ip or domain. But not really ! With haproxy tcp load balancer its super easy to have web socket channel on a subpath !! var ws= new WebSocket(“ws://oneplaylist.fm/websockets”)]]> Posted in OnePlaylist Engineering

Websocket are tcp connection independant from your web server / reverseproxy. So they need another tcp port. Its an issue if you are behind a firewall allowing only port 80 and you have only one ip or domain.

But not really ! With haproxy tcp load balancer its super easy to have web socket channel on a subpath !!

var ws= new WebSocket(“ws://oneplaylist.fm/websockets”)

]]> http://www.mathieu-elie.net/websocket-firewall-ok-on-port-80-and-subpath-on-samedomain-with-haproxy/feed/ 0 [Prez] datavisualization with d3.js + elasticsearch + bordeaux open data http://www.mathieu-elie.net/portfolio/prez-datavisualization-with-d3-js-elasticsearch-bordeaux-open-data/ http://www.mathieu-elie.net/portfolio/prez-datavisualization-with-d3-js-elasticsearch-bordeaux-open-data/#comments Tue, 19 Mar 2013 11:39:39 +0000 Matt http://www.mathieu-elie.net/?post_type=portfolio&p=2183 Posted in

Presentation for the BordeauxJS meetup. A demo of what could be done with this technologies: open data from bordeaux city google refine: a great tool from google to work on existing dataset elasticsearch: super scalable search engine angular.js: mvc browser javascript framework from google d3.js: great javascript library for datavisualization based on svg markup Check code samples at github dataviz on d3.js + elasticsearch from Mathieu Elie]]> Posted in

Check the live demo !

Presentation for the BordeauxJS meetup.
A demo of what could be done with this technologies:

Check code samples at github

]]> http://www.mathieu-elie.net/portfolio/prez-datavisualization-with-d3-js-elasticsearch-bordeaux-open-data/feed/ 0 Glances a new system-monitor tool via @linuxaria http://www.mathieu-elie.net/glances-a-new-system-monitor-tool-via-linuxaria/ http://www.mathieu-elie.net/glances-a-new-system-monitor-tool-via-linuxaria/#comments Tue, 05 Feb 2013 13:40:47 +0000 Matt http://www.mathieu-elie.net/?p=2154 Posted in Tech

» Linuxaria – Everything about GNU/Linux and Open source Glances a new system-monitor tool easy setup with python setup tools all in one top with better ui (focus on perf bottlenecks) i regret its not written in c (but python)]]> Posted in Tech

» Linuxaria – Everything about GNU/Linux and Open source Glances a new system-monitor tool

  • easy setup with python setup tools
  • all in one top with better ui (focus on perf bottlenecks)
  • i regret its not written in c (but python)
]]> http://www.mathieu-elie.net/glances-a-new-system-monitor-tool-via-linuxaria/feed/ 0 Facebook Scales Servers with Retooled Chef via @datacenter http://www.mathieu-elie.net/facebook-scales-servers-with-retooled-chef-via-datacenter/ http://www.mathieu-elie.net/facebook-scales-servers-with-retooled-chef-via-datacenter/#comments Tue, 05 Feb 2013 13:02:18 +0000 Matt http://www.mathieu-elie.net/?p=2150 Posted in Tech

Facebook Scales Servers with Retooled Chef » Data Center Knowledge chef become the standard for configuration management adopted by Facebook now great news for the tool and its futur now chef can scale and be tested at large scale at Facebook]]> Posted in Tech

Facebook Scales Servers with Retooled Chef » Data Center Knowledge

  • chef become the standard for configuration management
  • adopted by Facebook now
  • great news for the tool and its futur
  • now chef can scale and be tested at large scale at Facebook
]]> http://www.mathieu-elie.net/facebook-scales-servers-with-retooled-chef-via-datacenter/feed/ 0 Migrating from Ember.js to AngularJS via @cbeust http://www.mathieu-elie.net/migrating-from-ember-js-to-angularjs-via-cbeust/ http://www.mathieu-elie.net/migrating-from-ember-js-to-angularjs-via-cbeust/#comments Tue, 05 Feb 2013 11:57:00 +0000 Matt http://www.mathieu-elie.net/?p=2144 Posted in Tech

Migrating from Ember.js to AngularJS « Otaku, Cedric’s blog partials cleaner data binding (less work around needed) great doc easier debug]]> Posted in Tech

Migrating from Ember.js to AngularJS « Otaku, Cedric’s blog

  • partials
  • cleaner data binding (less work around needed)
  • great doc
  • easier debug
]]> http://www.mathieu-elie.net/migrating-from-ember-js-to-angularjs-via-cbeust/feed/ 0 Howler.js: A Cross Browser JavaScript Audio Playback Library via @badass_js http://www.mathieu-elie.net/howler-js-a-cross-browser-javascript-audio-playback-library-via-badass_js/ http://www.mathieu-elie.net/howler-js-a-cross-browser-javascript-audio-playback-library-via-badass_js/#comments Thu, 31 Jan 2013 10:08:30 +0000 Matt http://www.mathieu-elie.net/?p=2141 Posted in Tech

Howler.js: A Cross Browser JavaScript Audio Playback Library Supporting Audio Sprites – Badass JavaScript audio comes to browser ! HTML5 rocks ;) pure js (no outside javascripts) cool caching / sprites functions and other performance good practices handle multiple codecs for each browser versions play multiple sound at the same time !]]> Posted in Tech

Howler.js: A Cross Browser JavaScript Audio Playback Library Supporting Audio Sprites – Badass JavaScript

  • audio comes to browser ! HTML5 rocks ;)
  • pure js (no outside javascripts)
  • cool caching / sprites functions and other performance good practices
  • handle multiple codecs for each browser versions
  • play multiple sound at the same time !
]]> http://www.mathieu-elie.net/howler-js-a-cross-browser-javascript-audio-playback-library-via-badass_js/feed/ 0 Tweet ping – what i think #good #bad http://www.mathieu-elie.net/tweet-ping-what-i-think-good-bad/ http://www.mathieu-elie.net/tweet-ping-what-i-think-good-bad/#comments Thu, 31 Jan 2013 09:25:54 +0000 Matt http://www.mathieu-elie.net/?p=2138 Posted in Tech

Tweet ping yes, with dataviz we can make data appears sexy i think a one second buffer would be great to have a smoother progression this not firehose: only 2 companies on the world has access to all tweets in real time this type of geoviz (night + light) has a really cool effect technologies: Node.js on server: perfect for stream processing it gives me some ideas ;)]]> Posted in Tech

Tweet ping

  • yes, with dataviz we can make data appears sexy
  • i think a one second buffer would be great to have a smoother progression
  • this not firehose: only 2 companies on the world has access to all tweets in real time
  • this type of geoviz (night + light) has a really cool effect
  • technologies: Node.js on server: perfect for stream processing
  • it gives me some ideas ;)
]]> http://www.mathieu-elie.net/tweet-ping-what-i-think-good-bad/feed/ 0 Automating iTerm2 with Applescript via @b3nj http://www.mathieu-elie.net/automating-iterm2-with-applescript-via-b3nj/ http://www.mathieu-elie.net/automating-iterm2-with-applescript-via-b3nj/#comments Thu, 31 Jan 2013 09:17:14 +0000 Matt http://www.mathieu-elie.net/?p=2135 Posted in Tech

[BKRAFT/Articles] – Automating iTerm2 with Applescript iterm is a great tool term for mac with scripting you can automate opening windows, sessions, tabs you can write text as you typed it on your keyboard, ex: ssh myserer.com this is veyr handy if you want to open a lot of shell or always the same shell as logs, top etc… with this feature i will use less linux based sessions like tmux. in some cases, item2 ui has a better usability]]> Posted in Tech

[BKRAFT/Articles] – Automating iTerm2 with Applescript

  • iterm is a great tool term for mac
  • with scripting you can automate opening windows, sessions, tabs
  • you can write text as you typed it on your keyboard, ex: ssh myserer.com
  • this is veyr handy if you want to open a lot of shell or always the same shell as logs, top etc…
  • with this feature i will use less linux based sessions like tmux. in some cases, item2 ui has a better usability
]]> http://www.mathieu-elie.net/automating-iterm2-with-applescript-via-b3nj/feed/ 0 Monitoring Solr, ElasticSearch (and many more ! ) using JMX and Ganglia http://www.mathieu-elie.net/monitoring-solr-elasticsearch-and-many-more-using-jmx-and-ganglia/ http://www.mathieu-elie.net/monitoring-solr-elasticsearch-and-many-more-using-jmx-and-ganglia/#comments Thu, 24 Jan 2013 10:24:45 +0000 Matt http://www.mathieu-elie.net/?p=2131 Posted in Tech

Free Souls (Don’t LiVe to GeEk; GeEk to LiVe): Monitoring Solr, ElasticSearch using JMX and Ganglia Java application expose metrics thrue JMX. I’ve discovered this protocol working with cassandra. It should not be so tricky to push metrics to statsd, syslog or other protocols…. It would be a great open-source contrib to make a bridge from JMX to REST Json or other more open protocols… Watch my github…. maybe a day !]]> Posted in Tech

Free Souls (Don’t LiVe to GeEk; GeEk to LiVe): Monitoring Solr, ElasticSearch using JMX and Ganglia

Java application expose metrics thrue JMX. I’ve discovered this protocol working with cassandra.

It should not be so tricky to push metrics to statsd, syslog or other protocols….

It would be a great open-source contrib to make a bridge from JMX to REST Json or other more open protocols… Watch my github…. maybe a day !

]]> http://www.mathieu-elie.net/monitoring-solr-elasticsearch-and-many-more-using-jmx-and-ganglia/feed/ 0