Experiment Schema Extension (Ex-SE)
Interchange formats have been defined for queueing network models (PMIF), software performance models (S-PMIF), layered queueing networks (LQN), UML, Petri Nets and other types of models. In each format, a file specifies a model and a set of parameters for one run. Since modeling studies typically require multiple runs of the same model using different parameters (e.g., different workload mixes), this requires preparing and exchanging multiple interchange files. In addition, interchange formats do not specify the output metrics that are to be returned after model execution, typically resulting in either a default set of metrics or all possible metrics.
To address these issues, the Ex-SE is specified for defining a set of model runs and the output desired from them. It has the expressive power specify iterations, alternations, assignments of values, actions based on model results and more. This schema extension provides a means of specifying performance studies that is independent of a given tool paradigm. It requires only that a tool support the Ex-SE or have an interface that is capable of reading/writing extended interchange files. It may also be used in a stand-alone mode to specify studies for the tool in which the model was created, and it may specify measurement as well as modeling studies.
Experiments generate output metrics, such as response times, utilizations, etc. The Experiment specifies the output metrics desired; an Output Schema Extension (Output-SE) specifies the xml format for them. A performance analyst typically studies this output to form conclusions about the results of the experiments, then prepares a presentation and/or report to explain the results. Another extension, the
Results-SE specifies how to automatically transform the output metrics into useful results.