Model Selection Criteria and the Orthogonal Series Method
for Function Estimation

Closed--form solutions are presented for function
estimation using the orthogonal series method and various model selection
criteria.  While Akaike' AIC criterion does not lead to consistent estimates,
a family of criteria that includes Minimum Description Length
operates within a logarithmic factor of the minimax rate in a range of Sobolev
smoothness classes.