Asymptotically Optimal Regression Trees

Research output: Working paper/PreprintWorking paper

Abstract

Regression trees are evaluated with respect to mean square error (MSE), mean integrated square error (MISE), and integrated squared error (ISE), as the size of the training sample goes to infinity. The asymptotically MSE- and MISE minimizing (locally adaptive) regression trees are characterized. Under an optimal tree, MSE is O(n^{-2/3}). The estimator is shown to be asymptotically normally distributed. An estimator for ISE is also proposed, which may be used as a complement to cross-validation in the pruning of trees.
Original languageEnglish
Number of pages27
Publication statusPublished - 2018

Publication series

NameWorking Papers
PublisherLund University, Department of Economics
No.2018:12

Subject classification (UKÄ)

  • Economics

Free keywords

  • Piece-Wise Linear Regression
  • Partitioning Estimators
  • Non-Parametric Regression
  • Categorization
  • Partition
  • Prediction Trees
  • Decision Trees
  • Regression Trees
  • Regressogram
  • Mean Squared Error
  • C14
  • C38

Fingerprint

Dive into the research topics of 'Asymptotically Optimal Regression Trees'. Together they form a unique fingerprint.

Cite this