Do you know graylog2 ? Its big data for your logs (mongodb + elasticsearch + ruby on rails).
I’ve setup a syslog-ng server centralizing about 20 servers logs (from syslog). Then pipe it to a ruby eventmachine broker to distribute a websocket stream and graylog2 server at same time. I will make a post about this later: this post is a teasing.
You can see in this video a realtime graph of log count of about 20 servers every 1/10 seconds. Stay tuned !
ARVE Error: id and provider shortcodes attributes are mandatory for old shortcodes. It is recommended to switch to new shortcodes that need only url