Technical Reports - Query Results

Your query term was 'number = 2003-35'
1 report found
OFAI-TR-2003-35 ( 232kB PDF file)

Modeling Rule Precision

Johannes Fürnkranz

This paper reports first results of an empirical study of the precision of classification rules on an independent test set. We generated a large number of rules using a general covering algorithm and recorded their coverage on training and test sets. These meta data are briefly presented and analyzed with respect to their variance among different domains and search heuristics. The main part of the paper describes experiments that aimed at modeling the precision of the learned rules on the test set in dependence of their coverage on the training set. To this end, we trained a neural network as an evaluation function for a rule learner, and present parameter settings for the $m$-heuristic and the generalized $m$-heuristic that are optimal in the sense that they minimize the squared error of predicting the test set precision with training set coverage of positive and negative examples.

Keywords: Inductive Rule Learning, Overfitting, Error Estimates, Meta-Learning

Citation: Fürnkranz J.: Modeling Rule Precision. Technical Report, Österreichisches Forschungsinstitut für Artificial Intelligence, Wien, TR-2003-35, 2003