Modern Stochastics: Theory and Applications*

This paper deals with a homoskedastic errors-in-variables linear regression model and properties of the total least squares (TLS) estimator. We partly revise the consistency results for the TLS estimator previously obtained by the author [18]. We present complete and comprehensive proofs of consistency theorems. A theoretical foundation for construction of the TLS estimator and its relation to the generalized eigenvalue problem is explained. Particularly, the uniqueness of the estimate is proved. The Frobenius norm in the definition of the estimator can be substituted by the spectral norm, or by any other unitarily invariant norm; then the consistency results are still valid.

We consider a multivariate functional measurement error model $AX\approx B$. The errors in $[A,B]$ are uncorrelated, row-wise independent, and have equal (unknown) variances. We study the total least squares estimator of X, which, in the case of normal errors, coincides with the maximum likelihood one. We give conditions for asymptotic normality of the estimator when the number of rows in A is increasing. Under mild assumptions, the covariance structure of the limit Gaussian random matrix is nonsingular. For normal errors, the results can be used to construct an asymptotic confidence interval for a linear functional of X.

We consider a multivariate functional measurement error model $AX\approx B$. The errors in $[A,B]$ are uncorrelated, row-wise independent, and have equal (unknown) variances. We study the total least squares estimator of X, which, in the case of normal errors, coincides with the maximum likelihood one. We give conditions for asymptotic normality of the estimator when the number of rows in A is increasing. Under mild assumptions, the covariance structure of the limit Gaussian random matrix is nonsingular. For normal errors, the results can be used to construct an asymptotic confidence interval for a linear functional of X.

We obtain limit theorems for extreme residuals in linear regression model in the case of minimax estimation of parameters.

We obtain limit theorems for extreme residuals in linear regression model in the case of minimax estimation of parameters.