I mentioned it on github already: There is a comparison that is only slightly out-of-date. I think it could be brought into proper shape really quickly by the community. As for the benchmarking: I’m preparing a quadcore machine for some benchmarking with Fedora 17, so I could generate some initial data. it’s not server-grade hardware (i.e. there is no 15,000RPM HDD and it’s limited to 8GB of RAM), but I think the results could be representative.
I start to understand why there are so few benchmarks. It really is a lot of work and I’m still far from complete This really requires to read the documentation for most frameworks and create a small application for them as they provide no “Hello World” demo.
I managed to draw a few frameworks together and produce this (inconclusive) benchmark:
This has been conducted on a notebook equipped with a AMD E-450 CPU/GPU unit running Fedora 17 with a kernel patched and optimized for interactivity - which might explain some oddeties. E.g. Laravel is impressive but hardly that much
I blame it on a non-optimized Apache/PHP environment and a custom kernel. Perhaps I should’ve booted into the stock kernel but I’ve been too impatient to get a quick glance
By the way: samdark, are there any plans to revive the phpmark project? I’m a long way from being able to provide a really complete (i.e. go beyond simple “Hello World” demos) and fair (i.e. provide automated stats on memory consumption, disk I/O, etc) benchmarks. There will also be quite a lot of administrative overhead. The power of git submodules eases that a bit. But still …
Hm, the original phpmark has been set in place to provide a fair comparison. But from a marketing point, you’re actualy right. In the full benchmark, I’d like to include metrics like the spread of response times. As I see it, Yii is pretty constant there …
I’m wondering if it might be possible to offload the creation and maintenance of sample applications to the framework devs and introduce a github service similar to travis-ci. This would allow automated benchmarks and statistics. Is phpmark.com held by qiang?