Benchmarking of Middleware Systems

In todays IT world many different middleware systems are available. Often, the vendors of such applications proclaim that their product offers the best performance and scalability and actually is the best of all. This work demonstrates how to evaluate and compare the performance and scalability of different middleware systems in a realistic manner. The benchmarks for this purpose are implemented via several customized test cases. The first part of the work gives a detailed introduction into the terms benchmark, performance, scalability and middleware and presents three different middleware concepts: eXtensible Virtual Shared Memory (XVSM), JavaSpaces and Java 2 Plattform, Enterprise Edition (J2EE). In the second part, several benchmark scenarios are defined and implemented for the associated systems MozartSpaces, GigaSpaces eXtreme Application Platform (XAP) and JBoss Application Server (AS). The results of their execution are visualized and interpreted thereafter.