Open Source log collection and processing Software

Post with this tag will deal in one way or the other with Graylog2, an open-source log collection and processing software by Torch GmbH.

* Product Homepage: http://graylog2.com

* Graylog2 Source: https://github.com/Graylog2

* Google Groups: https://groups.google.com/d/forum/graylog2

* d-fens Source: https://github.com/search?q=user%3Adfch+graylog2

Clickatell Output Plugin for Graylog v1.0.0

Configured Plugin

Introduction This Graylog Output Plugin can send short messages (SMS) via the Clickatell Messaging Provider based on messages that are assigned to a specific stream in Graylog. It is based on the new version 1 plugin architecture. This plugin does essentially the same as the Clickatell AlarmCallback Plugin for Graylog, but works on streams instead […]

Clickatell AlarmCallback Plugin for Graylog v1.0.0

Graylog Clickatell AlarmCallback Configuration

Introduction This Graylog AlarmCallback Plugin can send short messages (SMS) via the Clickatell Messaging Provider based on alert conditions configured in Graylog. It is based on the new version 1 plugin architecture (though for AlarmCallback Plugins not that much has changed). Here is a brief overview of what is covered: Installation Configuration Options Testing Download […]

[NoBrainer] Graylog2 AlertConditions based on field contents

This post describes how you can extend the Graylog2 AlertCondition mechanism to raise alerts based on the contents of a field (instead of just a message count or a field value). Introduction Currently Graylog2 only allows you to trigger AlarmCallbacks based on either MESSAGE_COUNT Here you define how many messages must be assigned to that […]

[HOWTO] Creating a Graylog2 Filter Plugin

Introduction UPDATE 2015-02-26 The plugin now works with the Graylog v1 plugin API Following the article about Creating a Graylog2 Output Plugin this post will cover the steps needed to create a filter plugin for Graylog2. While the SCRIPT OUTPUT Plugin enabled a potential user to run scripts for post-processing of messages, the SCRIPT FILTER […]

[NoBrainer] Using drone.io to automatically integrate your Graylog2 Plugins in Docker

In this post I will quickly show you how to easily use drone.io and GitHub in combination with Docker to test your self developed Graylog2 plugins. Here is a brief overview of what is covered: Setting up drone.io integration Creating the Dockerfile Building the Docker image Running Graylog2 with plugins Summary and Notes Introduction As […]

[HOWTO] Creating a Graylog2 Output Plugin

Defining new Output

Introduction As described in my last post Sending Gelf messages to Graylog2 via PowerShell we were testing Graylog2 for log and meter collection. It soon became clear that the current selection of adapters to get data out of Graylog2 was far from perfect. We needed a specific output action to send data to an incident […]

[NoBrainer] Sending Gelf messages to Graylog2 via PowerShell

Bulk loading data into Graylog2

Recently I was testing Graylog2 as a store for metering data and had to bulk-load a larger amount of data into its database. My goal was to create synthetic and randomised metric information for a couple of virtual servers (5’000) over a period of one year at a sampling rate of 5s. This would make […]

[NoBrainer] Using Graylog2 REST API via PowerShell

Graylog2 api-browser

Graylog2 comes with a very limited alerting feature where you can basically only create alerts based on a single field. However, and thus far I can follow the motivation of the developers, nearly every larger company already has some kind of alerting solution in place, so why the bother to duplicate some functionality that would […]

Logging to Graylog2 using Gelf4Net via Powershell

Graylog2 is a powerful and scalable open source log management and data analytics system on top of elasticsearch. Since our logging module is based on log4net, the integration of Graylog2 as log destination is very easy thanks to the available gelf4net adapter. The gelf4net project provides a log4net adapter that formats logs to the GELF […]