A copy of this work was available on the public web and has been preserved in the Wayback Machine. The capture dates from 2007; you can also visit the original URL.
The file type is
Using permutations instead of student's t distribution for p-values in paired-difference algorithm comparisons
2004 IEEE International Joint Conference on Neural Networks (IEEE Cat. No.04CH37541)
The paired-difference t-test is commonly used in the machine learning community to determine whether one learning algorithm is better than another on a given learning task. This paper suggests the use of the permutation test instead because it calculates the exact p-value instead of an estimate. The permutation test is also distribution free and the time complexity is trivial for the commonly used 10-fold cross-validation paireddifference test. Results of experiments on real-world problemsdoi:10.1109/ijcnn.2004.1380138 fatcat:bpdyhc5usvetvjlmxavwnkbknq