noahd1 / oink

Log parser to identify actions which significantly increase VM heap size
MIT License
1.18k stars 71 forks source link

Understanding oink result #40

Closed benoittgt closed 4 years ago

benoittgt commented 8 years ago

The initial bash script curl logs from logentries for the last 24h and then parse them

It looks like this :

end=`ruby -e "puts Time.new.to_i * 1000"` && \
start=`ruby -e "puts (Time.new - 24.hours).to_i * 1000"` && \
var=`curl "https://pull.logentries.com/keeeyyyyyy/hosts/Heroku/my-product/?start=${start}&end=${end}&filter=%2Frails%5C%5B" | cut -c 59- > log/production-oink.log && oink --threshold=0 log/production-oink.log`

Why size looks always similar "151*\ kb" ? stores#colors is a realy small part in my codebase. Does oink tell me it is the worst code on my codebase with memory?

---- MEMORY THRESHOLD ----
THRESHOLD: 0 MB

-- SUMMARY --
Worst Requests:
1. Nov 23 09:50:50, 151876 KB, stores#colors
2. Nov 23 09:50:52, 151876 KB, stores#colors
3. Nov 23 09:50:57, 151876 KB, mobile_applications#index
4. Nov 23 09:51:43, 151556 KB, stores#colors
5. Nov 23 09:51:49, 151556 KB, mobile_applications#index
6. Nov 23 09:51:53, 151556 KB, mobile_application_updates#apkinfo
7. Nov 23 09:52:10, 151556 KB, mobile_applications#install
8. Nov 23 09:52:24, 151556 KB, subdomain_home#index
9. Nov 23 08:27:43, 141268 KB, mobile_applications#show
10. Nov 23 08:28:03, 141268 KB, home#ping

Worst Actions:
2765, stores#colors
2628, mobile_applications#index
1644, mobile_applications#show
1220, authentication/sessions#auth_mobile
1006, stores#android_mobile_store
971, mobile_application_updates#is_authorized
906, users#register_xpn_device
707, mobile_applications#install
698, api/v1/applications#index
643, home#ping
636, home#index
453, subdomain_home#index
441, subdomain_sessions#new
[...cut...]

Aggregated Totals:
Action Max Mean Min Total Number of requests
stores#colors 151876 29142 136 80578952 2765
mobile_applications#index 151876 27723 132 72857544 2628
mobile_applications#show 141268 28600 132 47018948 1644
authentication/sessions#auth_mobile 140928 28907 132 35267028 1220
stores#android_mobile_store 139104 29025 140 29199552 1006
mobile_application_updates#is_authorized 141268 27877 132 27069128 971
users#register_xpn_device 140928 29380 132 26618484 906
[...cut...]
benoittgt commented 8 years ago

Hello

Any chance to get any tips, help, feedbacks on this result ?

Cheers

dmitry commented 8 years ago

@benoittgt have you found other way to investigate applications memory consumption?

benoittgt commented 8 years ago

@dmitry We finally build our own tools. We will release it in the next month. Will keep you updated. At the same time look at https://github.com/schneems/derailed_benchmarks

dmitry commented 8 years ago

@benoittgt thanks for the link, looks promising :) looking forward for your own tools to be released. :rocket:

benoittgt commented 4 years ago

Stale issue. Closing for now.