RailsLogAnalyzer v0.2 for OSX - Faster, Better 6
Version 0.2 of the RailsLogAnalyzer is still a development version but a great improvement over my first prototype. This version has been rewritten from the ground up and doesn't use a database to store intermediate log file aggreation.
Analyzing your log file data.
Once the log file is loaded you will see a breakdown of your requests by year, month, and day.
Click on the year, month, or day to see the controllers invocations during that period.
Click on the controller in the chart to see the method invocations during the selected period.
The method are further broken down based on their http methods (get, post, delete, ...).
Note: loading a 10Mb production log file with 30000 requests takes about 10 seconds on my MacBook Pro.
loading a 250Mb production log file with 530000 requests takes about 2 minutes.
loading a 4.5Gb production log file with 11 million request takes about 45 minutes.
The data is loaded in memory and must be reloaded once the application is closed.
Download it here RailsLogAnalyzer_0.2.dmg (487KB) and let me know your findings at daniel@onrails.org
Analyzing your log file data.
Once the log file is loaded you will see a breakdown of your requests by year, month, and day.
Click on the year, month, or day to see the controllers invocations during that period.
Click on the controller in the chart to see the method invocations during the selected period.
The method are further broken down based on their http methods (get, post, delete, ...).
Note: loading a 10Mb production log file with 30000 requests takes about 10 seconds on my MacBook Pro.
loading a 250Mb production log file with 530000 requests takes about 2 minutes.
loading a 4.5Gb production log file with 11 million request takes about 45 minutes.
The data is loaded in memory and must be reloaded once the application is closed.
Download it here RailsLogAnalyzer_0.2.dmg (487KB) and let me know your findings at daniel@onrails.org
Great stuff! I’m just wondering if you could ‘zip’ it up since, as I’m on windows, I can’t open ‘dmg’s. Keep up the good work.
Let me know who else wants a Windows version? Note I will try RubyScript2Exe to package it for Windows. Any other recommendations to package for Windows? Give me a couple of days as I am currently at The Rails Edge conference in Denver.
Very nice tool!
One question. Could you explain the request’s chart axis meanings? Is the left side the number of requests in that hour and the right side the total time to service those requests?
Thanks for sharing this!
The left axis is for the column serie and the right for the line serie. The line serie is the cumulation of the columns. So if a year has 32000 requests, the line will end up at that number while the columns break it down by number of requests per month. Hope this clarifies it. Note that I am looking for feeback on what data to extract and aggregate from the log and how to represent it. So any question and feedback is welcome.
Looks great! I’ll download and try to share some feedback to you. Thanks for sharing.
Regarding the Windows packaging I tried Exerb to package the application as a Windows exe, but didn’t succeed so far. Any good pointer on how to package a ruby application as a Window exe is welcome. Not that I will follow Alex suggestion of just providing a plain ruby version in zip format. So anyone on Linux or Windows having ruby can run the application. On a good note I applied some performance improvments and went from 10seconds for a 10Mb log file to 2 seconds. From 2minutes for a 260Mb to 20seconds and from 45 minutes for a 4.5GB file to 10 minutes. That’s a 4 to 8 time speed improvment to analyze the log file. So watch out for the next release.