GeoStat

Version 0.2

GeoStat is a Python script for parsing Nginx and Apache logs files and getting GEO data from incoming IP's in it. This script convert parsed data in to Json format and send it to InfluxDB database so you can use it to build some nice Grafana dashboards for example. It runs as service by SystemD and parse log in "tailf" style.

Main Features:

Parsing incoming ip's from web server log and convert them in to GEO metrics for the InfluxDB.
Used standard python lib's for the maximus compatibility.
Having an external 'settings.ini' for comfortable changing parameters.

Tech

GeoStat uses a number of open source libs to work properly:

Geohash - Python module that provides functions for decoding and encoding Geohashes.
InfluxDB-Python - Python client for InfluxDB.

Installation

Using install.sh script:

Clone the repository.
CD into dir and run 'install.sh', it will ask you to set a properly settings.ini parameters, like Nginx access.log path, and InfluxDB settings.
After script will finished you only need to start SystemD service with 'systemctl start geostat.service'.

Manually:

Clone the repository.

$ cd geostat
$ virtualenv venv && source venv/bin/activate
$ pip install -r requirements.txt
$ cp settings.ini.bak settings.ini

Modify settings.ini & geostat.service files.

$ vi settings.ini
$ cp geostat.service.template geostat.service
$ vi geostat.service
$ cp geostat.service /lib/systemd/system/

Then enable and start service

$ systemctl enable geostat.service
$ systemctl start geostat.service

After first metrics will go to the InfluxDB you can create nice Grafana dashboards.

Have fun !

License

MIT

Free Software, Hell Yeah!

1.9 KiB Raw Blame History