Is it possible to store statistical data permanently? about nginx-module-vts HOT 13 CLOSED

I added that feature as mentioned above.
I haven't much test yet. 😆
It is vhost_traffic_status_dump directive as follows:

http {
    vhost_traffic_status_zone;
    vhost_traffic_status_dump /var/log/nginx/vts.db;

    ...

    server {

        ...

    }
}

Please see the vhost_traffic_status_dump directive for detailed usage.

Latest commit: fc73722

from nginx-module-vts.

Thought 👍

I thought about achieving the aim outlined above and came to the following solution. I need your opinion regarding this.. I can record the desired data, if I am not wrong, by creating a small application (e.g. PHP script) that reads the JSON file (the status page url) every 5 minutes and stores the data in a MySQL database. The data structure might look like this:

month (08-2016) | domain (example.com) | sent (bytes) | received (bytes)

The script checks what month is it now and updates the affected month's row (taking account for domain name)

What do you think about this solution? Thanks :-)

from nginx-module-vts.

Thanks suggestion.
This module does not have that feature.
In other words, JSON data stored in memory is no method to update just now. (You know, to delete or reset is possible.)
I would consider to solve your suggestion. (e.g. /status/control?cmd=update)

from nginx-module-vts.

@vozlt Thank you very much for the work put into this module. When it comes to updating, I meant updating an independent MySQL database table to store the statistical data in, not the module's data stored in memory. No need to update module's values, it should be enough to read the data and then store it somewhere else (a MySQL database for example). I have already achieved my goal with an outline like this:

MySQL database table:

main columns: zone (varchar), nginx main process start time (int - UNIX time-stamp), month (varchar like 08-2016) = these three columns should be defined as composite primary key. A small script (php, java..) reads the JSON data (provided by the module) every 1 minute and updates the MySQL table. That's all 👍

Additional columns: bytesIn, bytesOut updated on every reading (every minute).

The updating script can be scheduled to run using CRON.

from nginx-module-vts.

OK, thanks for detailed description.

from nginx-module-vts.

@acrolink - I wrote a collectd plugin for nginx_vts https://github.com/bobthemighty/collectd-vts - we send the metrics to riemann and then influx, but collectd also has a mysql output plugin, I think.

from nginx-module-vts.

hi @acrolink, can you share we us your PHP solution? I have the same problem. Thank you.

from nginx-module-vts.

@nottix .. Sure that should not be a problem.. I wrote it in c#/mono not PHP. The working setup consists mainly of a statistics reading & storing executable and a small web app to display the data. The code is missing currently a vital mechanism which should detect the beginning of a new month and reset the counters accordingly.. I will fix that and make the full code available here within the next few days.

from nginx-module-vts.

Thank you ;-)

from nginx-module-vts.

@nottix

Here you go:
https://github.com/acrolink/nginx-vts-records

I will add README in the next few days.. P.S. you need to install Mono for Linux, get nuget.exe, compile the executive (.exe) using Mono's xBuild and schedule it to run using cron..

from nginx-module-vts.

I'll try today, thank you ;-)

Il 09 set 2016 9:54 PM, "acrolink" [email protected] ha scritto:

@nottix https://github.com/nottix :-)

Here you go:
https://github.com/acrolink/nginx-vts-records

I will add README in the next few days.. P.S. you need to install Mono
for Linux, get nuget.exe, compile the executive (.exe) using Mono's xBuild
and schedule it to run using cron..

—
You are receiving this because you were mentioned.
Reply to this email directly, view it on GitHub
#50 (comment),
or mute the thread
https://github.com/notifications/unsubscribe-auth/AAFiyRvucJ7RBugckY71V1bSoFvA7zXIks5qobmFgaJpZM4JeGl_
.

from nginx-module-vts.

I have just added .sql to create DB structure.

from nginx-module-vts.

Perfect. Great work @vozlt thank you. I will happily test and report back in the near future.

from nginx-module-vts.