A common criticism of iterative least squares estimates of communality is that method of initial estimation may influence stabilized values. As little systematic research on this topic has been performed, the criticism appears to be based on cumulated experience with empirical data sets. In the present paper, two studies are reported in which four types of initial estimate (unities, squared multiple correlations, highest r, and zeroes) and four levels of convergence criterion were employed using four widely available computer packages (BMDP, SAS, SPSS, and SOUPAC). The results suggest that initial estimates have no effect on stabilized communality estimates when a stringent criterion for convergence is used, whereas initial estimates appear to affect stabilized values employing rather gross convergence criteria. There were no differences among the four computer packages for matrices without Heywood cases.

Horn’s parallel analysis is a widely used method for assessing the number of principal components and common factors. We discuss the theoretical foundations of parallel analysis for principal components based on a covariance matrix by making use of arguments from random matrix theory. In particular, we show that (i) for the first component, parallel analysis is an inferential method equivalent to the Tracy–Widom test, (ii) its use to test high-order eigenvalues is equivalent to the use of the joint distribution of the eigenvalues, and thus should be discouraged, and (iii) a formal test for higher-order components can be obtained based on a Tracy–Widom approximation. We illustrate the performance of the two testing procedures using simulated data generated under both a principal component model and a common factors model. For the principal component model, the Tracy–Widom test performs consistently in all conditions, while parallel analysis shows unpredictable behavior for higher-order components. For the common factor model, including major and minor factors, both procedures are heuristic approaches, with variable performance. We conclude that the Tracy–Widom procedure is preferred over parallel analysis for statistically testing the number of principal components based on a covariance matrix.

The assumptions of the model for factor analysis do not exclude a class of indeterminate covariances between factors and error variables (Grayson, 2003). The construction of all factors of the model for factor analysis is generalized to incorporate indeterminate factor-error covariances. A necessary and sufficient condition is given for indeterminate factor-error covariances to be arbitrarily small, for mean square convergence of the regression predictor of factor scores, and for the existence of a unique determinate factor and error variable. The determinate factor and error variable are uncorrelated and satisfy the defining assumptions of factor analysis. Several examples are given to illustrate the results.

FACTALS is a nonmetric common factor analysis model for multivariate data whose variables may be nominal, ordinal or interval. In FACTALS an Alternating Least Squares algorithm is utilized which is claimed to be monotonically convergent.

In this paper it is shown that this algorithm is based upon an erroneous assumption, namely that the least squares loss function (which is in this case a nonscale free loss function) can be transformed into a scalefree loss function. A consequence of this is that monotonical convergence of the algorithm can not be guaranteed.

Several sufficient conditions are available for mean square convergence of factor predictors. A necessary and sufficient condition is given in the Heywood case with respect to (confirmatory) factor analysis. This condition generalizes that of Krijnen (2006) and performs better than a signal-to-noise type of condition (Schneeweiss & Mathes, 1995).

For the confirmatory factor model a series of inequalities is given with respect to the mean square error (MSE) of three main factor score predictors. The eigenvalues of these MSE matrices are a monotonic function of the eigenvalues of the matrix Γp = Φ1/2Λ′pΨp−1ΛpΦ1/2. This matrix increases with the number of observable variables p. A necessary and sufficient condition for mean square convergence of predictors is divergence of the smallest eigenvalue of Γp or, equivalently, divergence of signal-to-noise (Schneeweiss & Mathes, 1995). The same condition is necessary and sufficient for convergence to zero of the positive definite MSE differences of factor predictors, convergence to zero of the distance between factor predictors, and convergence to the unit value of the relative efficiencies of predictors. Various illustrations and examples of the convergence are given as well as explicit recommendations on the problem of choosing between the three main factor score predictors.

Multitrait-Multimethod (MTMM) matrices are often analyzed by means of confirmatory factor analysis (CFA). However, fitting MTMM models often leads to improper solutions, or non-convergence. In an attempt to overcome these problems, various alternative CFA models have been proposed, but with none of these the problem of finding improper solutions was solved completely. In the present paper, an approach is proposed where improper solutions are ruled out altogether and convergence is guaranteed. The approach is based on constrained variants of components analysis (CA). Besides the fact that these methods do not give improper solutions, they have the advantage that they provide component scores which can later on be used to relate the components to external variables. The new methods are illustrated by means of simulated data, as well as empirical data sets.

If the ratio m/p tends to zero, where m is the number of factors m and m the number of observable variables, then the inverse diagonal element of the inverted observable covariance matrix tends to the corresponding unique variance ψjj for almost all of these (Guttman, 1956). If the smallest singular value of the loadings matrix from Common Factor Analysis tends to infinity as p increases, then m/p tends to zero. The same condition is necessary and sufficient for to tend to ψjj for all of these. Several related conditions are discussed.