A general setting is presented for the evaluation of several common multivariate analysis techniques including neural networks, support vector machines, and genetic programming. Various theoretical results from pure mathematics and statistical learning theory are presented. Special attention is placed on the optimization criterion for the search for new particles.

PACS numbers: 14.80.Bn, 02.40.-k, 02.60.-x, 07.05.Mh