2

Is there any open-source software that will record and display performance metrics for software that is built using a CI server (e.g. Buildbot)?

Everything I can find is geared at monitoring the performance of websites. I want to measure the performance of a benchmark that is run during the CI build.

I'm thinking something like this or this, but those appear to be custom solutions. Ideally it would support annotating the graph data points with their commits.

  • I have a similar query too :) – TCSGrad May 24 '18 at 21:00
1

Finally found one solution: Codespeed. It's a fairly simple Django server, originally created for comparing Python interpreter performance (see it in action here), but it works well for pretty much any benchmark.

The documentation is a little out of date, but Django is nice and simple so it's not too hard to set up.

Also it has the slightly odd concept of "Executables", which corresponds to the python interpreter used for the benchmark. My code is C++ so I have just interpreted this as the compiler, so I have "Clang -O3", "GCC -O0" and so on.

Result submission is via HTTP POST, which can be authenticated with HTTP Simple Auth (it isn't by default currently so anyone can submit results).

  • Please accept your own answer, in order to help others who read this in the future – Mawg Oct 12 '18 at 11:34

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.