Exploratory Factor Analysis - Basic

Overview

In this tutorial we walk through the very basics of conducting exploratory factor analysis (EFA) in R. This is not a comprehensive coverage, just enough to get one started.

Outline

In this session we cover …

A. Introduction to the Factor Analysis Model
B. Example 1: Basic EFA orientation & interpretation
C. Example 2: Choosing the number of factors, comparing solutions, etc…

Prelim - Loading libraries used in this script.

library(psych)       #psychometrics basic functions
## Warning: package 'psych' was built under R version 4.3.3
library(corrplot)    #plotting correlation matrices
library(GPArotation) #methods for factor rotation
library(nFactors)    #methods for determining the number of factors
library(tidyverse)   #ggplot2, dplyr, tidyr, readr, purr, tibble, stringr, forcats

Introduction to the Factor Analysis Model

The basic factor analysis model is written as

\[y_{pi} = \lambda_{pq} f_{qi} + u_{pi}\] where \(y_{pi}\) is individual i’s score on the pth observed variable, \(f_{qi}\) is individual i’s score on the qth latent common factor, \(u_{pi}\) is individual i’s score on the pth latent unique factor, and \(\lambda_{pq}\) is the factor loading that indicates the relation between the pth observed variable and the qth latent common factor.

Typically, we have multiple observed variables and one or more common factors. FOr instance in the 6 variable, 2 factor case we would have …

\[y_{1i} = \lambda_{11} f_{1i} + \lambda_{12} f_{2i} + u_{1i}\] \[y_{2i} = \lambda_{21} f_{1i} + \lambda_{22} f_{2i} + u_{2i}\] \[y_{3i} = \lambda_{31} f_{1i} + \lambda_{32} f_{2i} + u_{3i}\] \[y_{4i} = \lambda_{41} f_{1i} + \lambda_{42} f_{2i} + u_{4i}\] \[y_{5i} = \lambda_{51} f_{1i} + \lambda_{52} f_{2i} + u_{5i}\] \[y_{6i} = \lambda_{61} f_{1i} + \lambda_{62} f_{2i} + u_{6i}\] which can be written in a compact matrix form as

\[ \boldsymbol{Y_{i}} = \boldsymbol{\Lambda}\boldsymbol{F_{i}} + \boldsymbol{U_{i}} \] where \(\boldsymbol{Y_{i}}\) is a \(p\) x 1 vector of observed variable scores, \(\boldsymbol{\Lambda}\) is a p x q matrix of factor loadings, \(\boldsymbol{F_{i}}\) is a \(q\) x 1 vector of common factor scores, and \(\boldsymbol{U_{i}}\) is a p x 1 vector of unique factor scores.

Extension to multiple persons provided for mapping to the observed correlation matrix, \(\boldsymbol{\Sigma} = \boldsymbol{Y}'\boldsymbol{Y}\) and the common factor model becomes

\[ \boldsymbol{\Sigma} = \boldsymbol{\Lambda}\boldsymbol{\Psi}\boldsymbol{\Lambda}' + \boldsymbol{\Theta} \] where \(\boldsymbol{\Sigma}\) is a p x p covariance (or correlation) matrix of the observed variables, \(\boldsymbol{\Lambda}\) is a p x q matrix of factor loadings, \(\boldsymbol{\Psi}\) is a q x q covariance matrix of the latent factor variables, and \(\boldsymbol{\Theta}\) is a diagonal matrix of unique factor variances.

Prelim - Reading in Multiobservation Multivariate Data

For this example, we use data from the web that are collected and distributed at https://openpsychometrics.org/_rawdata/.

The data were obtained from 19,719 participants (rows) who provided answers to the Big Five Personality Test, constructed with items from the International Personality Item Pool. Data columns include gender, age, race, native language, country, and answers to the 50 likert rated statements (1-5;0 if missed; 1 was labeled as “strongly disagree”, 2 was labeled as “disagree”, 3 was labeled as “neither agree not disagree”, 4 was labeled as “agree” and 5 was labeled as “strongly agree”).

The original files can be obtained at http://openpsychometrics.org/_rawdata/BIG5.zip

#Setting the working directory
#setwd("~/Desktop/FactorAnalysis")  #Person 1 Computer
#setwd("~/Desktop/FactorAnalysis")  #Person 2 Computer

#Reading the data from web location
dat = read.csv(file="https://raw.githubusercontent.com/The-Change-Lab/collaborations/refs/heads/main/GrowthModeling/dataBIG5.csv", header=TRUE)

#dat = read.csv(file="https://raw.githubusercontent.com/The-Change-Lab/collaborations/main/GrowthModeling/dataBIG5.csv", header=TRUE)

Lets have a quick look at the data file and the descriptives.

#data structure
head(dat, 10)
##    race age engnat gender hand source country E1 E2 E3 E4 E5 E6 E7 E8 E9 E10 N1
## 1     3  53      1      1    1      1      US  4  2  5  2  5  1  4  3  5   1  1
## 2    13  46      1      2    1      1      US  2  2  3  3  3  3  1  5  1   5  2
## 3     1  14      2      2    1      1      PK  5  1  1  4  5  1  1  5  5   1  5
## 4     3  19      2      2    1      1      RO  2  5  2  4  3  4  3  4  4   5  5
## 5    11  25      2      2    1      2      US  3  1  3  3  3  1  3  1  3   5  3
## 6    13  31      1      2    1      2      US  1  5  2  4  1  3  2  4  1   5  1
## 7     5  20      1      2    1      5      US  5  1  5  1  5  1  5  4  4   1  2
## 8     4  23      2      1    1      2      IN  4  3  5  3  5  1  4  3  4   3  1
## 9     5  39      1      2    3      4      US  3  1  5  1  5  1  5  2  5   3  2
## 10    3  18      1      2    1      5      US  1  4  2  5  2  4  1  4  1   5  5
##    N2 N3 N4 N5 N6 N7 N8 N9 N10 A1 A2 A3 A4 A5 A6 A7 A8 A9 A10 C1 C2 C3 C4 C5 C6
## 1   5  2  5  1  1  1  1  1   1  1  5  1  5  2  3  1  5  4   5  4  1  5  1  5  1
## 2   3  4  2  3  4  3  2  2   4  1  3  3  4  4  4  2  3  4   3  4  1  3  2  3  1
## 3   1  5  5  5  5  5  5  5   5  5  1  5  5  1  5  1  5  5   5  4  1  5  1  5  1
## 4   4  4  2  4  5  5  5  4   5  2  5  4  4  3  5  3  4  4   3  3  3  4  5  1  4
## 5   3  3  4  3  3  3  3  3   4  5  5  3  5  1  5  1  5  5   5  3  1  5  3  3  1
## 6   5  4  5  1  4  4  1  5   2  2  2  3  4  3  4  3  5  5   3  2  5  4  3  3  4
## 7   4  2  4  2  2  3  2  2   2  5  5  1  5  1  5  1  5  4   5  2  4  3  3  3  3
## 8   4  4  4  1  1  1  1  1   1  2  5  1  4  3  3  1  3  4   5  4  2  5  1  4  1
## 9   4  5  3  3  5  5  4  3   3  1  5  1  5  1  5  1  5  5   4  4  3  5  2  5  2
## 10  2  5  2  3  4  3  2  3   4  2  3  1  4  2  4  3  3  3   2  5  2  4  2  3  2
##    C7 C8 C9 C10 O1 O2 O3 O4 O5 O6 O7 O8 O9 O10
## 1   4  1  4   5  4  1  3  1  5  1  4  2  5   5
## 2   5  1  4   4  3  3  3  3  2  3  3  1  3   2
## 3   5  1  5   5  4  5  5  1  5  1  5  5  5   5
## 4   5  4  2   3  4  3  5  2  4  2  5  2  5   5
## 5   1  3  3   3  3  1  1  1  3  1  3  1  5   3
## 6   5  3  5   3  4  2  1  3  3  5  5  4  5   3
## 7   3  3  3   3  3  1  5  1  4  1  4  3  3   4
## 8   4  1  3   5  3  1  5  1  4  1  5  3  2   5
## 9   5  2  4   3  3  3  5  3  5  1  5  3  4   5
## 10  4  2  4   4  4  2  5  2  4  1  4  3  4   4

Note that for ease, there is no id variable. We simply assume each row is a separate person. For convenience, we remove the first 8 variables that are not part of the item pool and recode 0 to NA;

#removing first 7 columns
dat <- dat[ ,8:57]
#replacing 0 with NA
dat[dat == 0] <- NA
#descriptives
psych::describe(dat)
##     vars     n mean   sd median trimmed  mad min max range  skew kurtosis   se
## E1     1 19718 2.63 1.23      3    2.57 1.48   1   5     4  0.21    -0.96 0.01
## E2     2 19718 2.76 1.31      3    2.70 1.48   1   5     4  0.21    -1.08 0.01
## E3     3 19718 3.42 1.24      4    3.50 1.48   1   5     4 -0.35    -0.88 0.01
## E4     4 19718 3.15 1.22      3    3.19 1.48   1   5     4 -0.10    -0.94 0.01
## E5     5 19718 3.43 1.28      4    3.53 1.48   1   5     4 -0.40    -0.94 0.01
## E6     6 19718 2.45 1.24      2    2.34 1.48   1   5     4  0.54    -0.74 0.01
## E7     7 19718 2.87 1.43      3    2.83 1.48   1   5     4  0.12    -1.32 0.01
## E8     8 19718 3.38 1.27      3    3.45 1.48   1   5     4 -0.28    -1.00 0.01
## E9     9 19718 3.09 1.40      3    3.12 1.48   1   5     4 -0.09    -1.28 0.01
## E10   10 19718 3.59 1.30      4    3.71 1.48   1   5     4 -0.51    -0.94 0.01
## N1    11 19718 3.26 1.31      3    3.33 1.48   1   5     4 -0.21    -1.10 0.01
## N2    12 19718 3.23 1.18      3    3.27 1.48   1   5     4 -0.18    -0.85 0.01
## N3    13 19718 3.84 1.14      4    3.98 1.48   1   5     4 -0.83    -0.16 0.01
## N4    14 19718 2.76 1.22      3    2.70 1.48   1   5     4  0.23    -0.88 0.01
## N5    15 19718 2.95 1.27      3    2.94 1.48   1   5     4  0.04    -1.09 0.01
## N6    16 19718 2.98 1.32      3    2.98 1.48   1   5     4  0.03    -1.16 0.01
## N7    17 19718 3.15 1.30      3    3.19 1.48   1   5     4 -0.11    -1.12 0.01
## N8    18 19718 2.80 1.35      3    2.75 1.48   1   5     4  0.17    -1.18 0.01
## N9    19 19718 3.14 1.30      3    3.17 1.48   1   5     4 -0.13    -1.12 0.01
## N10   20 19718 2.83 1.31      3    2.79 1.48   1   5     4  0.14    -1.12 0.01
## A1    21 19718 2.31 1.37      2    2.14 1.48   1   5     4  0.69    -0.84 0.01
## A2    22 19718 3.93 1.08      4    4.07 1.48   1   5     4 -0.88     0.07 0.01
## A3    23 19718 2.16 1.22      2    2.02 1.48   1   5     4  0.75    -0.55 0.01
## A4    24 19718 4.03 1.05      4    4.20 1.48   1   5     4 -1.06     0.55 0.01
## A5    25 19718 2.17 1.14      2    2.02 1.48   1   5     4  0.86    -0.06 0.01
## A6    26 19718 3.90 1.13      4    4.05 1.48   1   5     4 -0.87    -0.05 0.01
## A7    27 19718 2.16 1.13      2    2.02 1.48   1   5     4  0.84    -0.10 0.01
## A8    28 19718 3.77 1.04      4    3.87 1.48   1   5     4 -0.69    -0.04 0.01
## A9    29 19718 3.94 1.09      4    4.10 1.48   1   5     4 -1.00     0.35 0.01
## A10   30 19718 3.68 1.05      4    3.77 1.48   1   5     4 -0.51    -0.28 0.01
## C1    31 19718 3.32 1.10      3    3.35 1.48   1   5     4 -0.32    -0.59 0.01
## C2    32 19718 2.98 1.37      3    2.97 1.48   1   5     4 -0.03    -1.25 0.01
## C3    33 19718 3.98 1.00      4    4.12 1.48   1   5     4 -0.88     0.23 0.01
## C4    34 19718 2.65 1.24      3    2.58 1.48   1   5     4  0.31    -0.92 0.01
## C5    35 19718 2.70 1.25      3    2.63 1.48   1   5     4  0.25    -0.94 0.01
## C6    36 19718 2.92 1.40      3    2.90 1.48   1   5     4  0.06    -1.31 0.01
## C7    37 19718 3.65 1.15      4    3.76 1.48   1   5     4 -0.61    -0.40 0.01
## C8    38 19718 2.48 1.13      2    2.42 1.48   1   5     4  0.32    -0.66 0.01
## C9    39 19718 3.22 1.25      3    3.28 1.48   1   5     4 -0.22    -0.96 0.01
## C10   40 19718 3.64 1.01      4    3.71 1.48   1   5     4 -0.43    -0.27 0.01
## O1    41 19718 3.69 1.12      4    3.80 1.48   1   5     4 -0.60    -0.36 0.01
## O2    42 19718 2.15 1.14      2    2.01 1.48   1   5     4  0.78    -0.23 0.01
## O3    43 19718 4.13 1.01      4    4.28 1.48   1   5     4 -1.09     0.61 0.01
## O4    44 19718 2.08 1.11      2    1.93 1.48   1   5     4  0.85    -0.02 0.01
## O5    45 19718 3.87 0.94      4    3.95 1.48   1   5     4 -0.62     0.09 0.01
## O6    46 19718 1.79 1.07      1    1.58 0.00   1   5     4  1.40     1.25 0.01
## O7    47 19718 4.07 0.92      4    4.18 1.48   1   5     4 -0.94     0.63 0.01
## O8    48 19718 3.21 1.26      3    3.26 1.48   1   5     4 -0.22    -0.97 0.01
## O9    49 19718 4.13 0.98      4    4.29 1.48   1   5     4 -1.13     0.83 0.01
## O10   50 19718 4.00 0.98      4    4.12 1.48   1   5     4 -0.79     0.04 0.01

Of particular interest for what we are doing is the correlation matrix. We can look at both the numeric and visual versions

round(cor(dat, use="complete.obs"), 2)
##        E1    E2    E3    E4    E5    E6    E7    E8    E9   E10    N1    N2
## E1   1.00 -0.42  0.47 -0.48  0.48 -0.35  0.59 -0.37  0.46 -0.41 -0.11  0.15
## E2  -0.42  1.00 -0.45  0.53 -0.54  0.57 -0.48  0.37 -0.37  0.46  0.06 -0.03
## E3   0.47 -0.45  1.00 -0.48  0.59 -0.39  0.58 -0.32  0.42 -0.47 -0.24  0.28
## E4  -0.48  0.53 -0.48  1.00 -0.51  0.47 -0.50  0.45 -0.45  0.51  0.15 -0.09
## E5   0.48 -0.54  0.59 -0.51  1.00 -0.48  0.63 -0.35  0.42 -0.54 -0.13  0.13
## E6  -0.35  0.57 -0.39  0.47 -0.48  1.00 -0.41  0.32 -0.33  0.41  0.11 -0.05
## E7   0.59 -0.48  0.58 -0.50  0.63 -0.41  1.00 -0.35  0.43 -0.53 -0.14  0.16
## E8  -0.37  0.37 -0.32  0.45 -0.35  0.32 -0.35  1.00 -0.51  0.38  0.09 -0.05
## E9   0.46 -0.37  0.42 -0.45  0.42 -0.33  0.43 -0.51  1.00 -0.37 -0.13  0.14
## E10 -0.41  0.46 -0.47  0.51 -0.54  0.41 -0.53  0.38 -0.37  1.00  0.18 -0.09
## N1  -0.11  0.06 -0.24  0.15 -0.13  0.11 -0.14  0.09 -0.13  0.18  1.00 -0.46
## N2   0.15 -0.03  0.28 -0.09  0.13 -0.05  0.16 -0.05  0.14 -0.09 -0.46  1.00
## N3  -0.12  0.06 -0.20  0.18 -0.09  0.09 -0.13  0.11 -0.11  0.20  0.55 -0.40
## N4   0.14 -0.07  0.20 -0.11  0.12 -0.05  0.13 -0.08  0.12 -0.11 -0.25  0.26
## N5  -0.07  0.04 -0.18  0.13 -0.10  0.14 -0.11  0.04 -0.06  0.15  0.39 -0.26
## N6  -0.10  0.04 -0.22  0.15 -0.12  0.13 -0.14  0.05 -0.08  0.18  0.54 -0.38
## N7  -0.05  0.04 -0.21  0.14 -0.10  0.11 -0.09  0.02 -0.03  0.16  0.42 -0.29
## N8  -0.06  0.05 -0.23  0.15 -0.12  0.12 -0.11  0.02 -0.04  0.16  0.43 -0.33
## N9  -0.09  0.05 -0.25  0.15 -0.14  0.12 -0.15  0.07 -0.07  0.20  0.49 -0.34
## N10 -0.19  0.19 -0.36  0.28 -0.24  0.20 -0.24  0.13 -0.15  0.25  0.42 -0.36
## A1  -0.02  0.12 -0.12  0.11 -0.11  0.19 -0.08 -0.01  0.02  0.08  0.00  0.02
## A2   0.27 -0.27  0.43 -0.25  0.38 -0.29  0.36 -0.17  0.22 -0.24 -0.05  0.12
## A3   0.05 -0.04 -0.12  0.02 -0.04  0.01 -0.02 -0.04  0.06  0.05  0.11 -0.06
## A4   0.09 -0.11  0.22 -0.06  0.19 -0.12  0.15 -0.01  0.04 -0.07  0.07  0.02
## A5  -0.11  0.21 -0.24  0.16 -0.24  0.23 -0.18  0.08 -0.07  0.15  0.00  0.01
## A6   0.06 -0.06  0.12 -0.01  0.11 -0.02  0.08  0.01  0.01  0.00  0.14 -0.01
## A7  -0.23  0.30 -0.40  0.28 -0.36  0.34 -0.35  0.17 -0.17  0.25  0.05 -0.05
## A8   0.15 -0.15  0.26 -0.11  0.24 -0.17  0.21  0.00  0.07 -0.11 -0.01  0.07
## A9   0.14 -0.14  0.22 -0.10  0.23 -0.15  0.18 -0.06  0.12 -0.10  0.06  0.00
## A10  0.31 -0.25  0.40 -0.25  0.39 -0.25  0.35 -0.14  0.23 -0.24 -0.14  0.17
## C1   0.05 -0.01  0.16 -0.05  0.11 -0.06  0.07  0.01  0.04 -0.05 -0.08  0.08
## C2   0.04 -0.05 -0.03  0.02  0.01 -0.02  0.02 -0.06  0.05  0.02  0.09  0.03
## C3   0.01  0.02  0.07  0.02  0.07 -0.05  0.03  0.06  0.00  0.01 -0.02  0.04
## C4  -0.06  0.04 -0.21  0.16 -0.13  0.12 -0.09  0.03 -0.04  0.13  0.26 -0.14
## C5   0.08 -0.02  0.17 -0.07  0.15 -0.02  0.13 -0.02  0.05 -0.09 -0.10  0.05
## C6  -0.01 -0.01 -0.10  0.06 -0.05  0.06 -0.04 -0.01  0.01  0.08  0.13 -0.02
## C7  -0.03  0.02  0.03  0.03  0.03 -0.02  0.00  0.08 -0.02  0.04  0.05 -0.04
## C8  -0.04  0.08 -0.18  0.13 -0.14  0.14 -0.10  0.03 -0.02  0.13  0.14 -0.04
## C9   0.05 -0.03  0.15 -0.05  0.13 -0.04  0.08  0.00  0.04 -0.03  0.01 -0.02
## C10  0.05 -0.02  0.11 -0.02  0.10 -0.08  0.07  0.00  0.06 -0.02 -0.05  0.03
## O1   0.04 -0.06  0.03 -0.05  0.09 -0.18  0.06 -0.03  0.07 -0.07 -0.05  0.04
## O2  -0.03  0.06 -0.07  0.10 -0.07  0.19 -0.06  0.05 -0.08  0.10  0.17 -0.08
## O3   0.07 -0.04  0.00  0.03  0.06 -0.09  0.04 -0.04  0.09 -0.01  0.03  0.03
## O4  -0.01  0.04 -0.02  0.06 -0.05  0.15 -0.04  0.04 -0.05  0.06  0.09 -0.04
## O5   0.18 -0.13  0.16 -0.14  0.20 -0.23  0.16 -0.13  0.22 -0.14 -0.13  0.13
## O6  -0.09  0.10 -0.08  0.09 -0.11  0.19 -0.09  0.10 -0.12  0.09  0.07 -0.07
## O7   0.08 -0.06  0.14 -0.07  0.12 -0.15  0.10 -0.02  0.12 -0.09 -0.17  0.14
## O8   0.00 -0.02 -0.07  0.01  0.01 -0.11  0.01 -0.01  0.05 -0.01  0.02 -0.02
## O9  -0.08  0.07 -0.09  0.11 -0.03 -0.02 -0.05  0.08 -0.04  0.11  0.11 -0.06
## O10  0.16 -0.14  0.12 -0.13  0.20 -0.26  0.16 -0.12  0.20 -0.13 -0.09  0.09
##        N3    N4    N5    N6    N7    N8    N9   N10    A1    A2    A3    A4
## E1  -0.12  0.14 -0.07 -0.10 -0.05 -0.06 -0.09 -0.19 -0.02  0.27  0.05  0.09
## E2   0.06 -0.07  0.04  0.04  0.04  0.05  0.05  0.19  0.12 -0.27 -0.04 -0.11
## E3  -0.20  0.20 -0.18 -0.22 -0.21 -0.23 -0.25 -0.36 -0.12  0.43 -0.12  0.22
## E4   0.18 -0.11  0.13  0.15  0.14  0.15  0.15  0.28  0.11 -0.25  0.02 -0.06
## E5  -0.09  0.12 -0.10 -0.12 -0.10 -0.12 -0.14 -0.24 -0.11  0.38 -0.04  0.19
## E6   0.09 -0.05  0.14  0.13  0.11  0.12  0.12  0.20  0.19 -0.29  0.01 -0.12
## E7  -0.13  0.13 -0.11 -0.14 -0.09 -0.11 -0.15 -0.24 -0.08  0.36 -0.02  0.15
## E8   0.11 -0.08  0.04  0.05  0.02  0.02  0.07  0.13 -0.01 -0.17 -0.04 -0.01
## E9  -0.11  0.12 -0.06 -0.08 -0.03 -0.04 -0.07 -0.15  0.02  0.22  0.06  0.04
## E10  0.20 -0.11  0.15  0.18  0.16  0.16  0.20  0.25  0.08 -0.24  0.05 -0.07
## N1   0.55 -0.25  0.39  0.54  0.42  0.43  0.49  0.42  0.00 -0.05  0.11  0.07
## N2  -0.40  0.26 -0.26 -0.38 -0.29 -0.33 -0.34 -0.36  0.02  0.12 -0.06  0.02
## N3   1.00 -0.25  0.32  0.45  0.36  0.35  0.38  0.39 -0.02  0.01  0.08  0.14
## N4  -0.25  1.00 -0.13 -0.21 -0.24 -0.25 -0.20 -0.39  0.06  0.04 -0.06  0.01
## N5   0.32 -0.13  1.00  0.48  0.37  0.39  0.43  0.31  0.08 -0.07  0.13  0.01
## N6   0.45 -0.21  0.48  1.00  0.51  0.54  0.60  0.45  0.05 -0.08  0.16  0.06
## N7   0.36 -0.24  0.37  0.51  1.00  0.77  0.50  0.48  0.11 -0.07  0.22 -0.02
## N8   0.35 -0.25  0.39  0.54  0.77  1.00  0.53  0.54  0.12 -0.10  0.21 -0.02
## N9   0.38 -0.20  0.43  0.60  0.50  0.53  1.00  0.41  0.11 -0.15  0.31 -0.09
## N10  0.39 -0.39  0.31  0.45  0.48  0.54  0.41  1.00  0.08 -0.14  0.16 -0.02
## A1  -0.02  0.06  0.08  0.05  0.11  0.12  0.11  0.08  1.00 -0.23  0.19 -0.33
## A2   0.01  0.04 -0.07 -0.08 -0.07 -0.10 -0.15 -0.14 -0.23  1.00 -0.15  0.40
## A3   0.08 -0.06  0.13  0.16  0.22  0.21  0.31  0.16  0.19 -0.15  1.00 -0.31
## A4   0.14  0.01  0.01  0.06 -0.02 -0.02 -0.09 -0.02 -0.33  0.40 -0.31  1.00
## A5  -0.07  0.02  0.06  0.01  0.06  0.06  0.12  0.06  0.34 -0.42  0.24 -0.50
## A6   0.18 -0.01  0.11  0.18  0.06  0.06 -0.01  0.05 -0.21  0.25 -0.27  0.51
## A7  -0.01 -0.01  0.11  0.08  0.13  0.14  0.19  0.17  0.35 -0.57  0.24 -0.44
## A8   0.06  0.03 -0.06 -0.03 -0.06 -0.07 -0.13 -0.08 -0.26  0.36 -0.20  0.46
## A9   0.14  0.00  0.03  0.08  0.02  0.03 -0.05  0.01 -0.25  0.38 -0.25  0.65
## A10 -0.07  0.13 -0.10 -0.13 -0.12 -0.14 -0.19 -0.19 -0.13  0.32 -0.22  0.32
## C1  -0.05  0.10 -0.15 -0.14 -0.16 -0.17 -0.12 -0.18 -0.03  0.07 -0.12  0.04
## C2   0.06 -0.05  0.09  0.11  0.13  0.12  0.09  0.11 -0.01  0.07  0.15  0.02
## C3   0.10  0.02 -0.10 -0.07 -0.06 -0.08 -0.04 -0.05 -0.02  0.09 -0.06  0.09
## C4   0.21 -0.13  0.26  0.30  0.33  0.35  0.28  0.34  0.08 -0.05  0.27 -0.03
## C5  -0.06  0.15 -0.10 -0.10 -0.14 -0.13 -0.13 -0.17  0.02  0.06 -0.18  0.09
## C6   0.10 -0.05  0.17  0.20  0.19  0.19  0.15  0.16  0.05  0.00  0.17 -0.01
## C7   0.10  0.02 -0.01 -0.01 -0.04 -0.07  0.03 -0.06 -0.07  0.02 -0.05  0.05
## C8   0.10 -0.09  0.19  0.19  0.25  0.28  0.20  0.24  0.17 -0.11  0.23 -0.11
## C9   0.06  0.08 -0.07 -0.05 -0.11 -0.11 -0.03 -0.13 -0.05  0.08 -0.12  0.10
## C10  0.01  0.06 -0.09 -0.07 -0.09 -0.10 -0.04 -0.09 -0.03  0.08 -0.10  0.07
## O1  -0.05 -0.02 -0.12 -0.09 -0.09 -0.08 -0.05  0.00 -0.11  0.07  0.04 -0.01
## O2   0.14  0.01  0.21  0.20  0.14  0.15  0.17  0.09  0.12 -0.05  0.05 -0.01
## O3   0.08 -0.03  0.01  0.04  0.08  0.07  0.04  0.07 -0.02  0.08  0.07  0.07
## O4   0.05  0.06  0.13  0.12  0.07  0.08  0.12  0.01  0.12 -0.11  0.05 -0.07
## O5  -0.09  0.08 -0.09 -0.11 -0.08 -0.09 -0.07 -0.12 -0.02  0.11  0.02  0.03
## O6   0.04  0.01  0.09  0.07  0.02  0.03  0.08  0.06  0.05 -0.10  0.04 -0.06
## O7  -0.11  0.07 -0.16 -0.15 -0.10 -0.11 -0.11 -0.11 -0.01  0.08 -0.04  0.03
## O8   0.02 -0.06 -0.03 -0.01  0.06  0.06  0.06  0.10 -0.05 -0.01  0.16 -0.07
## O9   0.18 -0.07  0.05  0.09  0.08  0.07  0.09  0.17 -0.11  0.09 -0.01  0.14
## O10 -0.06  0.04 -0.09 -0.08 -0.03 -0.04 -0.06 -0.05 -0.04  0.14  0.04  0.04
##        A5    A6    A7    A8    A9   A10    C1    C2    C3    C4    C5    C6
## E1  -0.11  0.06 -0.23  0.15  0.14  0.31  0.05  0.04  0.01 -0.06  0.08 -0.01
## E2   0.21 -0.06  0.30 -0.15 -0.14 -0.25 -0.01 -0.05  0.02  0.04 -0.02 -0.01
## E3  -0.24  0.12 -0.40  0.26  0.22  0.40  0.16 -0.03  0.07 -0.21  0.17 -0.10
## E4   0.16 -0.01  0.28 -0.11 -0.10 -0.25 -0.05  0.02  0.02  0.16 -0.07  0.06
## E5  -0.24  0.11 -0.36  0.24  0.23  0.39  0.11  0.01  0.07 -0.13  0.15 -0.05
## E6   0.23 -0.02  0.34 -0.17 -0.15 -0.25 -0.06 -0.02 -0.05  0.12 -0.02  0.06
## E7  -0.18  0.08 -0.35  0.21  0.18  0.35  0.07  0.02  0.03 -0.09  0.13 -0.04
## E8   0.08  0.01  0.17  0.00 -0.06 -0.14  0.01 -0.06  0.06  0.03 -0.02 -0.01
## E9  -0.07  0.01 -0.17  0.07  0.12  0.23  0.04  0.05  0.00 -0.04  0.05  0.01
## E10  0.15  0.00  0.25 -0.11 -0.10 -0.24 -0.05  0.02  0.01  0.13 -0.09  0.08
## N1   0.00  0.14  0.05 -0.01  0.06 -0.14 -0.08  0.09 -0.02  0.26 -0.10  0.13
## N2   0.01 -0.01 -0.05  0.07  0.00  0.17  0.08  0.03  0.04 -0.14  0.05 -0.02
## N3  -0.07  0.18 -0.01  0.06  0.14 -0.07 -0.05  0.06  0.10  0.21 -0.06  0.10
## N4   0.02 -0.01 -0.01  0.03  0.00  0.13  0.10 -0.05  0.02 -0.13  0.15 -0.05
## N5   0.06  0.11  0.11 -0.06  0.03 -0.10 -0.15  0.09 -0.10  0.26 -0.10  0.17
## N6   0.01  0.18  0.08 -0.03  0.08 -0.13 -0.14  0.11 -0.07  0.30 -0.10  0.20
## N7   0.06  0.06  0.13 -0.06  0.02 -0.12 -0.16  0.13 -0.06  0.33 -0.14  0.19
## N8   0.06  0.06  0.14 -0.07  0.03 -0.14 -0.17  0.12 -0.08  0.35 -0.13  0.19
## N9   0.12 -0.01  0.19 -0.13 -0.05 -0.19 -0.12  0.09 -0.04  0.28 -0.13  0.15
## N10  0.06  0.05  0.17 -0.08  0.01 -0.19 -0.18  0.11 -0.05  0.34 -0.17  0.16
## A1   0.34 -0.21  0.35 -0.26 -0.25 -0.13 -0.03 -0.01 -0.02  0.08  0.02  0.05
## A2  -0.42  0.25 -0.57  0.36  0.38  0.32  0.07  0.07  0.09 -0.05  0.06  0.00
## A3   0.24 -0.27  0.24 -0.20 -0.25 -0.22 -0.12  0.15 -0.06  0.27 -0.18  0.17
## A4  -0.50  0.51 -0.44  0.46  0.65  0.32  0.04  0.02  0.09 -0.03  0.09 -0.01
## A5   1.00 -0.32  0.56 -0.41 -0.45 -0.25 -0.03 -0.02 -0.05  0.04 -0.05  0.02
## A6  -0.32  1.00 -0.28  0.35  0.48  0.26  0.00  0.02  0.03  0.00  0.08  0.03
## A7   0.56 -0.28  1.00 -0.39 -0.40 -0.30 -0.05 -0.01 -0.06  0.10 -0.06  0.04
## A8  -0.41  0.35 -0.39  1.00  0.43  0.33  0.09  0.00  0.12 -0.06  0.11 -0.04
## A9  -0.45  0.48 -0.40  0.43  1.00  0.35  0.05  0.01  0.11 -0.04  0.11 -0.01
## A10 -0.25  0.26 -0.30  0.33  0.35  1.00  0.11 -0.03  0.12 -0.17  0.17 -0.08
## C1  -0.03  0.00 -0.05  0.09  0.05  0.11  1.00 -0.26  0.30 -0.35  0.39 -0.31
## C2  -0.02  0.02 -0.01  0.00  0.01 -0.03 -0.26  1.00 -0.16  0.40 -0.36  0.51
## C3  -0.05  0.03 -0.06  0.12  0.11  0.12  0.30 -0.16  1.00 -0.19  0.20 -0.21
## C4   0.04  0.00  0.10 -0.06 -0.04 -0.17 -0.35  0.40 -0.19  1.00 -0.36  0.46
## C5  -0.05  0.08 -0.06  0.11  0.11  0.17  0.39 -0.36  0.20 -0.36  1.00 -0.39
## C6   0.02  0.03  0.04 -0.04 -0.01 -0.08 -0.31  0.51 -0.21  0.46 -0.39  1.00
## C7  -0.01  0.04 -0.02  0.07  0.04  0.05  0.31 -0.26  0.25 -0.26  0.29 -0.30
## C8   0.14 -0.06  0.17 -0.14 -0.10 -0.16 -0.32  0.23 -0.17  0.39 -0.37  0.31
## C9  -0.07  0.07 -0.08  0.12  0.13  0.12  0.43 -0.27  0.23 -0.31  0.42 -0.32
## C10 -0.04  0.04 -0.05  0.10  0.10  0.19  0.33 -0.14  0.34 -0.23  0.28 -0.20
## O1  -0.01 -0.08 -0.04  0.02  0.00  0.05  0.13  0.07  0.15 -0.03 -0.03  0.00
## O2   0.06  0.08  0.08 -0.02 -0.03 -0.05 -0.07  0.00 -0.13  0.11  0.03  0.05
## O3  -0.03  0.04 -0.04  0.04  0.10  0.08 -0.01  0.09  0.12  0.09 -0.07  0.09
## O4   0.12  0.01  0.13 -0.05 -0.07 -0.04  0.00 -0.04 -0.09  0.04  0.05  0.00
## O5  -0.01  0.00 -0.07  0.06  0.08  0.20  0.20  0.01  0.20 -0.13  0.09 -0.03
## O6   0.08 -0.02  0.13 -0.06 -0.10 -0.11 -0.02 -0.02 -0.10  0.04  0.03  0.01
## O7  -0.02 -0.04 -0.04  0.07  0.07  0.16  0.22 -0.01  0.24 -0.15  0.10 -0.06
## O8   0.04 -0.11  0.04 -0.03 -0.04 -0.03  0.04  0.11  0.10  0.09 -0.10  0.07
## O9  -0.08  0.10 -0.06  0.11  0.15  0.05  0.03  0.05  0.14  0.05 -0.04  0.02
## O10 -0.05  0.01 -0.10  0.08  0.10  0.17  0.11  0.06  0.18 -0.02  0.02  0.03
##        C7    C8    C9   C10    O1    O2    O3    O4    O5    O6    O7    O8
## E1  -0.03 -0.04  0.05  0.05  0.04 -0.03  0.07 -0.01  0.18 -0.09  0.08  0.00
## E2   0.02  0.08 -0.03 -0.02 -0.06  0.06 -0.04  0.04 -0.13  0.10 -0.06 -0.02
## E3   0.03 -0.18  0.15  0.11  0.03 -0.07  0.00 -0.02  0.16 -0.08  0.14 -0.07
## E4   0.03  0.13 -0.05 -0.02 -0.05  0.10  0.03  0.06 -0.14  0.09 -0.07  0.01
## E5   0.03 -0.14  0.13  0.10  0.09 -0.07  0.06 -0.05  0.20 -0.11  0.12  0.01
## E6  -0.02  0.14 -0.04 -0.08 -0.18  0.19 -0.09  0.15 -0.23  0.19 -0.15 -0.11
## E7   0.00 -0.10  0.08  0.07  0.06 -0.06  0.04 -0.04  0.16 -0.09  0.10  0.01
## E8   0.08  0.03  0.00  0.00 -0.03  0.05 -0.04  0.04 -0.13  0.10 -0.02 -0.01
## E9  -0.02 -0.02  0.04  0.06  0.07 -0.08  0.09 -0.05  0.22 -0.12  0.12  0.05
## E10  0.04  0.13 -0.03 -0.02 -0.07  0.10 -0.01  0.06 -0.14  0.09 -0.09 -0.01
## N1   0.05  0.14  0.01 -0.05 -0.05  0.17  0.03  0.09 -0.13  0.07 -0.17  0.02
## N2  -0.04 -0.04 -0.02  0.03  0.04 -0.08  0.03 -0.04  0.13 -0.07  0.14 -0.02
## N3   0.10  0.10  0.06  0.01 -0.05  0.14  0.08  0.05 -0.09  0.04 -0.11  0.02
## N4   0.02 -0.09  0.08  0.06 -0.02  0.01 -0.03  0.06  0.08  0.01  0.07 -0.06
## N5  -0.01  0.19 -0.07 -0.09 -0.12  0.21  0.01  0.13 -0.09  0.09 -0.16 -0.03
## N6  -0.01  0.19 -0.05 -0.07 -0.09  0.20  0.04  0.12 -0.11  0.07 -0.15 -0.01
## N7  -0.04  0.25 -0.11 -0.09 -0.09  0.14  0.08  0.07 -0.08  0.02 -0.10  0.06
## N8  -0.07  0.28 -0.11 -0.10 -0.08  0.15  0.07  0.08 -0.09  0.03 -0.11  0.06
## N9   0.03  0.20 -0.03 -0.04 -0.05  0.17  0.04  0.12 -0.07  0.08 -0.11  0.06
## N10 -0.06  0.24 -0.13 -0.09  0.00  0.09  0.07  0.01 -0.12  0.06 -0.11  0.10
## A1  -0.07  0.17 -0.05 -0.03 -0.11  0.12 -0.02  0.12 -0.02  0.05 -0.01 -0.05
## A2   0.02 -0.11  0.08  0.08  0.07 -0.05  0.08 -0.11  0.11 -0.10  0.08 -0.01
## A3  -0.05  0.23 -0.12 -0.10  0.04  0.05  0.07  0.05  0.02  0.04 -0.04  0.16
## A4   0.05 -0.11  0.10  0.07 -0.01 -0.01  0.07 -0.07  0.03 -0.06  0.03 -0.07
## A5  -0.01  0.14 -0.07 -0.04 -0.01  0.06 -0.03  0.12 -0.01  0.08 -0.02  0.04
## A6   0.04 -0.06  0.07  0.04 -0.08  0.08  0.04  0.01  0.00 -0.02 -0.04 -0.11
## A7  -0.02  0.17 -0.08 -0.05 -0.04  0.08 -0.04  0.13 -0.07  0.13 -0.04  0.04
## A8   0.07 -0.14  0.12  0.10  0.02 -0.02  0.04 -0.05  0.06 -0.06  0.07 -0.03
## A9   0.04 -0.10  0.13  0.10  0.00 -0.03  0.10 -0.07  0.08 -0.10  0.07 -0.04
## A10  0.05 -0.16  0.12  0.19  0.05 -0.05  0.08 -0.04  0.20 -0.11  0.16 -0.03
## C1   0.31 -0.32  0.43  0.33  0.13 -0.07 -0.01  0.00  0.20 -0.02  0.22  0.04
## C2  -0.26  0.23 -0.27 -0.14  0.07  0.00  0.09 -0.04  0.01 -0.02 -0.01  0.11
## C3   0.25 -0.17  0.23  0.34  0.15 -0.13  0.12 -0.09  0.20 -0.10  0.24  0.10
## C4  -0.26  0.39 -0.31 -0.23 -0.03  0.11  0.09  0.04 -0.13  0.04 -0.15  0.09
## C5   0.29 -0.37  0.42  0.28 -0.03  0.03 -0.07  0.05  0.09  0.03  0.10 -0.10
## C6  -0.30  0.31 -0.32 -0.20  0.00  0.05  0.09  0.00 -0.03  0.01 -0.06  0.07
## C7   1.00 -0.21  0.40  0.28  0.06  0.01 -0.02  0.03  0.08  0.03  0.09  0.02
## C8  -0.21  1.00 -0.31 -0.27 -0.07  0.09  0.03  0.06 -0.11  0.05 -0.13  0.04
## C9   0.40 -0.31  1.00  0.31  0.00  0.04 -0.06  0.06  0.09  0.03  0.08 -0.05
## C10  0.28 -0.27  0.31  1.00  0.14 -0.11  0.05 -0.07  0.24 -0.06  0.26  0.10
## O1   0.06 -0.07  0.00  0.14  1.00 -0.33  0.24 -0.23  0.31 -0.21  0.34  0.63
## O2   0.01  0.09  0.04 -0.11 -0.33  1.00 -0.21  0.54 -0.28  0.28 -0.37 -0.28
## O3  -0.02  0.03 -0.06  0.05  0.24 -0.21  1.00 -0.23  0.30 -0.53  0.16  0.21
## O4   0.03  0.06  0.06 -0.07 -0.23  0.54 -0.23  1.00 -0.19  0.28 -0.19 -0.22
## O5   0.08 -0.11  0.09  0.24  0.31 -0.28  0.30 -0.19  1.00 -0.33  0.38  0.25
## O6   0.03  0.05  0.03 -0.06 -0.21  0.28 -0.53  0.28 -0.33  1.00 -0.18 -0.14
## O7   0.09 -0.13  0.08  0.26  0.34 -0.37  0.16 -0.19  0.38 -0.18  1.00  0.27
## O8   0.02  0.04 -0.05  0.10  0.63 -0.28  0.21 -0.22  0.25 -0.14  0.27  1.00
## O9   0.10 -0.01  0.05  0.11  0.20 -0.16  0.21 -0.20  0.14 -0.12  0.11  0.19
## O10  0.03 -0.06  0.02  0.19  0.30 -0.31  0.43 -0.28  0.62 -0.43  0.33  0.27
##        O9   O10
## E1  -0.08  0.16
## E2   0.07 -0.14
## E3  -0.09  0.12
## E4   0.11 -0.13
## E5  -0.03  0.20
## E6  -0.02 -0.26
## E7  -0.05  0.16
## E8   0.08 -0.12
## E9  -0.04  0.20
## E10  0.11 -0.13
## N1   0.11 -0.09
## N2  -0.06  0.09
## N3   0.18 -0.06
## N4  -0.07  0.04
## N5   0.05 -0.09
## N6   0.09 -0.08
## N7   0.08 -0.03
## N8   0.07 -0.04
## N9   0.09 -0.06
## N10  0.17 -0.05
## A1  -0.11 -0.04
## A2   0.09  0.14
## A3  -0.01  0.04
## A4   0.14  0.04
## A5  -0.08 -0.05
## A6   0.10  0.01
## A7  -0.06 -0.10
## A8   0.11  0.08
## A9   0.15  0.10
## A10  0.05  0.17
## C1   0.03  0.11
## C2   0.05  0.06
## C3   0.14  0.18
## C4   0.05 -0.02
## C5  -0.04  0.02
## C6   0.02  0.03
## C7   0.10  0.03
## C8  -0.01 -0.06
## C9   0.05  0.02
## C10  0.11  0.19
## O1   0.20  0.30
## O2  -0.16 -0.31
## O3   0.21  0.43
## O4  -0.20 -0.28
## O5   0.14  0.62
## O6  -0.12 -0.43
## O7   0.11  0.33
## O8   0.19  0.27
## O9   1.00  0.19
## O10  0.19  1.00

And a re-organized compact visual version from the corrplot package.

#visual correlation matrix
corrplot(cor(dat, use="complete.obs"), 
         order = "original", 
         tl.col='black', tl.cex=.75) 

That is a bit messy for interpretation (mix of positive and negative correlations), so the function has some reordering options that are helpful (e.g., order = “hclust”).

corrplot(cor(dat, use="complete.obs"), 
         order = "hclust", 
         tl.col='black', tl.cex=.75) 

We see that there are some “clumps” of items that are positively correlated - evidence of some common factors.

The correlations are all based on standardized data.

Lets standardize for ease.

dat_standard <- data.frame(scale(dat, center=TRUE, scale=TRUE))
#descriptives
psych::describe(dat_standard)
##     vars     n mean sd median trimmed  mad   min  max range  skew kurtosis   se
## E1     1 19718    0  1   0.30   -0.05 1.20 -1.32 1.92  3.25  0.21    -0.96 0.01
## E2     2 19718    0  1   0.18   -0.05 1.13 -1.34 1.71  3.04  0.21    -1.08 0.01
## E3     3 19718    0  1   0.47    0.07 1.20 -1.95 1.28  3.23 -0.35    -0.88 0.01
## E4     4 19718    0  1  -0.12    0.03 1.21 -1.76 1.51  3.27 -0.10    -0.94 0.01
## E5     5 19718    0  1   0.44    0.08 1.16 -1.90 1.22  3.12 -0.40    -0.94 0.01
## E6     6 19718    0  1  -0.36   -0.09 1.19 -1.17 2.05  3.22  0.54    -0.74 0.01
## E7     7 19718    0  1   0.09   -0.02 1.04 -1.30 1.49  2.79  0.12    -1.32 0.01
## E8     8 19718    0  1  -0.30    0.06 1.17 -1.88 1.28  3.16 -0.28    -1.00 0.01
## E9     9 19718    0  1  -0.07    0.02 1.06 -1.50 1.36  2.86 -0.09    -1.28 0.01
## E10   10 19718    0  1   0.32    0.09 1.14 -1.98 1.08  3.07 -0.51    -0.94 0.01
## N1    11 19718    0  1  -0.20    0.05 1.13 -1.73 1.33  3.06 -0.21    -1.10 0.01
## N2    12 19718    0  1  -0.20    0.03 1.26 -1.90 1.50  3.40 -0.18    -0.85 0.01
## N3    13 19718    0  1   0.14    0.12 1.30 -2.50 1.02  3.51 -0.83    -0.16 0.01
## N4    14 19718    0  1   0.20   -0.05 1.21 -1.44 1.84  3.28  0.23    -0.88 0.01
## N5    15 19718    0  1   0.04   -0.01 1.16 -1.53 1.61  3.14  0.04    -1.09 0.01
## N6    16 19718    0  1   0.01    0.00 1.12 -1.50 1.53  3.03  0.03    -1.16 0.01
## N7    17 19718    0  1  -0.12    0.03 1.14 -1.66 1.42  3.08 -0.11    -1.12 0.01
## N8    18 19718    0  1   0.15   -0.04 1.10 -1.34 1.63  2.96  0.17    -1.18 0.01
## N9    19 19718    0  1  -0.10    0.03 1.14 -1.64 1.44  3.08 -0.13    -1.12 0.01
## N10   20 19718    0  1   0.13   -0.03 1.13 -1.40 1.65  3.05  0.14    -1.12 0.01
## A1    21 19718    0  1  -0.23   -0.13 1.08 -0.96 1.96  2.92  0.69    -0.84 0.01
## A2    22 19718    0  1   0.07    0.14 1.38 -2.71 1.00  3.71 -0.88     0.07 0.01
## A3    23 19718    0  1  -0.13   -0.12 1.22 -0.96 2.33  3.29  0.75    -0.55 0.01
## A4    24 19718    0  1  -0.03    0.16 1.42 -2.90 0.93  3.83 -1.06     0.55 0.01
## A5    25 19718    0  1  -0.15   -0.13 1.30 -1.02 2.48  3.50  0.86    -0.06 0.01
## A6    26 19718    0  1   0.09    0.14 1.31 -2.56 0.98  3.54 -0.87    -0.05 0.01
## A7    27 19718    0  1  -0.14   -0.12 1.31 -1.03 2.51  3.53  0.84    -0.10 0.01
## A8    28 19718    0  1   0.23    0.10 1.43 -2.67 1.19  3.86 -0.69    -0.04 0.01
## A9    29 19718    0  1   0.05    0.15 1.37 -2.71 0.97  3.69 -1.00     0.35 0.01
## A10   30 19718    0  1   0.30    0.08 1.41 -2.55 1.25  3.80 -0.51    -0.28 0.01
## C1    31 19718    0  1  -0.29    0.03 1.35 -2.11 1.53  3.64 -0.32    -0.59 0.01
## C2    32 19718    0  1   0.02    0.00 1.08 -1.45 1.48  2.93 -0.03    -1.25 0.01
## C3    33 19718    0  1   0.02    0.14 1.48 -2.98 1.01  3.99 -0.88     0.23 0.01
## C4    34 19718    0  1   0.28   -0.06 1.19 -1.33 1.89  3.22  0.31    -0.92 0.01
## C5    35 19718    0  1   0.24   -0.06 1.19 -1.36 1.84  3.20  0.25    -0.94 0.01
## C6    36 19718    0  1   0.06   -0.01 1.06 -1.37 1.48  2.86  0.06    -1.31 0.01
## C7    37 19718    0  1   0.31    0.09 1.29 -2.30 1.17  3.47 -0.61    -0.40 0.01
## C8    38 19718    0  1  -0.43   -0.06 1.31 -1.31 2.22  3.53  0.32    -0.66 0.01
## C9    39 19718    0  1  -0.18    0.05 1.19 -1.79 1.42  3.21 -0.22    -0.96 0.01
## C10   40 19718    0  1   0.36    0.07 1.46 -2.61 1.35  3.95 -0.43    -0.27 0.01
## O1    41 19718    0  1   0.28    0.09 1.33 -2.41 1.17  3.58 -0.60    -0.36 0.01
## O2    42 19718    0  1  -0.13   -0.12 1.31 -1.01 2.51  3.52  0.78    -0.23 0.01
## O3    43 19718    0  1  -0.13    0.15 1.47 -3.11 0.87  3.97 -1.09     0.61 0.01
## O4    44 19718    0  1  -0.07   -0.14 1.34 -0.97 2.63  3.60  0.85    -0.02 0.01
## O5    45 19718    0  1   0.13    0.08 1.58 -3.06 1.20  4.26 -0.62     0.09 0.01
## O6    46 19718    0  1  -0.74   -0.20 0.00 -0.74 3.00  3.74  1.40     1.25 0.01
## O7    47 19718    0  1  -0.08    0.12 1.61 -3.33 1.00  4.33 -0.94     0.63 0.01
## O8    48 19718    0  1  -0.17    0.04 1.18 -1.75 1.42  3.18 -0.22    -0.97 0.01
## O9    49 19718    0  1  -0.14    0.15 1.51 -3.19 0.88  4.07 -1.13     0.83 0.01
## O10   50 19718    0  1  -0.01    0.12 1.51 -3.06 1.01  4.07 -0.79     0.04 0.01

Example 1: Basic EFA Orientation & Interpretation

The base package in R has the function factanal() for doing EFA. This function uses ‘maximum likelihood’ (ML, as opposed to, say, ‘principal components’, PC) to derive the factors. When ML is used, there exists a (conservative) significance test for the null hypothesis that the q extracted factors are sufficient. This is convenient.

The psych package has the function fa() for doing EFA that has many additional options.

For the moment, we use the function in the base package factanal(). By default the function factanal() will rotate the factors using varimax rotation (rotation = ‘varimax’). Let’s start by just looking at the unrotated factors.

On a technical note, here we are doing maximum likelihood (ML) estimation, assuming that our observed variables come from a mixture of several Gaussian distributions (i.e., each latent variable is from a unique Gaussian distribution with some noise). Options embedded in the fa() function allow for other possibilities.

Our goal is to figure out which variables “belong” to which distribution/latent factor.

Factor analysis with no rotation

EFAresult1 = factanal(~ ., data=dat_standard, 
                      factors = 10, 
                      rotation = "none", 
                      na.action = na.exclude) #note the formula specification allows NA 
EFAresult1
## 
## Call:
## factanal(x = ~., factors = 10, data = dat_standard, na.action = na.exclude,     rotation = "none")
## 
## Uniquenesses:
##    E1    E2    E3    E4    E5    E6    E7    E8    E9   E10    N1    N2    N3 
## 0.515 0.480 0.396 0.432 0.394 0.516 0.397 0.663 0.598 0.516 0.434 0.577 0.519 
##    N4    N5    N6    N7    N8    N9   N10    A1    A2    A3    A4    A5    A6 
## 0.806 0.660 0.426 0.295 0.168 0.468 0.529 0.734 0.493 0.702 0.328 0.494 0.562 
##    A7    A8    A9   A10    C1    C2    C3    C4    C5    C6    C7    C8    C9 
## 0.368 0.634 0.394 0.645 0.598 0.601 0.752 0.516 0.572 0.527 0.691 0.682 0.589 
##   C10    O1    O2    O3    O4    O5    O6    O7    O8    O9   O10 
## 0.699 0.356 0.602 0.395 0.690 0.404 0.496 0.663 0.367 0.815 0.378 
## 
## Loadings:
##     Factor1 Factor2 Factor3 Factor4 Factor5 Factor6 Factor7 Factor8 Factor9
## E1  -0.453   0.333          -0.361                   0.120                 
## E2   0.445  -0.391           0.349           0.124           0.128         
## E3  -0.662   0.257  -0.110  -0.233                                         
## E4   0.532  -0.264           0.400                   0.115           0.107 
## E5  -0.590   0.402          -0.270   0.118                                 
## E6   0.501  -0.324  -0.146   0.175           0.146   0.174   0.106         
## E7  -0.564   0.369          -0.344                                         
## E8   0.320  -0.252           0.369                                   0.130 
## E9  -0.397   0.294   0.136  -0.333                                         
## E10  0.525  -0.225           0.358                                   0.103 
## N1   0.489   0.397           0.109   0.122  -0.190          -0.311         
## N2  -0.394  -0.236                  -0.159   0.240   0.192   0.263         
## N3   0.393   0.382  -0.103   0.222   0.108  -0.137          -0.288         
## N4  -0.294  -0.176                           0.145   0.198                 
## N5   0.432   0.307                                   0.137  -0.164         
## N6   0.539   0.459                   0.115                  -0.191         
## N7   0.580   0.526                   0.152   0.101           0.195         
## N8   0.629   0.556                   0.174   0.102  -0.103   0.253         
## N9   0.559   0.356                   0.199           0.101  -0.167         
## N10  0.591   0.310           0.109                                         
## A1   0.242  -0.169   0.137  -0.261   0.157   0.197   0.155                 
## A2  -0.449   0.407  -0.165   0.111  -0.144                           0.259 
## A3   0.275           0.293  -0.306                   0.117           0.114 
## A4  -0.276   0.433  -0.368   0.441  -0.201                          -0.153 
## A5   0.332  -0.375   0.291  -0.280   0.204           0.157          -0.110 
## A6  -0.108   0.365  -0.342   0.325  -0.113   0.103   0.133          -0.167 
## A7   0.489  -0.395   0.252  -0.165   0.185   0.117   0.181          -0.256 
## A8  -0.323   0.318  -0.242   0.284                                         
## A9  -0.272   0.474  -0.287   0.385  -0.122                          -0.196 
## A10 -0.466   0.268                           0.129   0.149                 
## C1  -0.281  -0.105           0.252   0.474                           0.108 
## C2   0.135   0.208   0.152  -0.160  -0.469           0.228           0.115 
## C3  -0.171           0.119   0.322   0.283                           0.115 
## C4   0.429   0.269          -0.172  -0.390           0.164                 
## C5  -0.270          -0.163   0.187   0.521                                 
## C6   0.249   0.207   0.122  -0.191  -0.490           0.245                 
## C7                           0.269   0.446                                 
## C8   0.372   0.113          -0.230  -0.299                                 
## C9  -0.218          -0.142   0.245   0.512                                 
## C10 -0.222           0.105   0.280   0.360           0.139                 
## O1  -0.185           0.581   0.244          -0.404           0.138         
## O2   0.263          -0.430  -0.200                   0.259                 
## O3           0.246   0.468   0.228  -0.125   0.304          -0.203         
## O4   0.185          -0.329  -0.215   0.163           0.287                 
## O5  -0.328   0.149   0.522   0.175   0.124   0.228   0.138                 
## O6   0.215  -0.174  -0.411  -0.186   0.100  -0.303   0.236   0.178         
## O7  -0.278           0.391   0.207   0.109                   0.149         
## O8           0.116   0.600   0.171          -0.412   0.107   0.183         
## O9           0.174   0.183   0.336                                         
## O10 -0.288   0.223   0.573   0.194           0.270          -0.130         
##     Factor10
## E1          
## E2          
## E3          
## E4          
## E5          
## E6   0.113  
## E7   0.117  
## E8          
## E9          
## E10         
## N1          
## N2          
## N3          
## N4          
## N5          
## N6          
## N7          
## N8          
## N9          
## N10         
## A1          
## A2          
## A3          
## A4          
## A5          
## A6          
## A7          
## A8          
## A9          
## A10         
## C1          
## C2          
## C3          
## C4          
## C5          
## C6          
## C7          
## C8          
## C9          
## C10         
## O1          
## O2   0.129  
## O3   0.333  
## O4          
## O5  -0.262  
## O6  -0.177  
## O7  -0.143  
## O8          
## O9          
## O10 -0.167  
## 
##                Factor1 Factor2 Factor3 Factor4 Factor5 Factor6 Factor7 Factor8
## SS loadings      7.400   4.126   3.097   3.033   2.390   1.001   0.853   0.713
## Proportion Var   0.148   0.083   0.062   0.061   0.048   0.020   0.017   0.014
## Cumulative Var   0.148   0.231   0.292   0.353   0.401   0.421   0.438   0.452
##                Factor9 Factor10
## SS loadings      0.431    0.421
## Proportion Var   0.009    0.008
## Cumulative Var   0.461    0.469
## 
## Test of the hypothesis that 10 factors are sufficient.
## The chi square statistic is 21206.81 on 770 degrees of freedom.
## The p-value is 0

First, we can look at the sums of squared (SS) loadings; these are the eigenvalues, or the variance in all variables which is accounted for by that factor (i.e., the eigenvalue/# of variables = proportion variance). If a factor has a “high” SS loading (i.e., eigenvalue), then it is helping to explain the variances in the variables. In the factanal() output, the factors are ordered by their eigenvalues, with higher eigenvalues first.

A general rule-of-thumb called the Kaiser Rule, is that a factor is important/useful if its eigenvalue is greater than 1 (i.e., the average), Here, factors 1-6 appear to be important. There are other ways to choose the number of factors, which we will look at later.

To illustrate how the eigenvalue is calculated.

#Calculate eigenvalue
loadings_fac1 = EFAresult1$loadings[,1] #loadings for first factor (1st column of Lambda)
loadings_fac1
##          E1          E2          E3          E4          E5          E6 
## -0.45325445  0.44467549 -0.66213951  0.53177773 -0.58989927  0.50084460 
##          E7          E8          E9         E10          N1          N2 
## -0.56437000  0.31989101 -0.39714714  0.52490713  0.48889454 -0.39392659 
##          N3          N4          N5          N6          N7          N8 
##  0.39327228 -0.29403882  0.43184868  0.53942838  0.57994036  0.62893349 
##          N9         N10          A1          A2          A3          A4 
##  0.55922805  0.59119442  0.24157455 -0.44921521  0.27526202 -0.27595555 
##          A5          A6          A7          A8          A9         A10 
##  0.33239541 -0.10808022  0.48893918 -0.32260320 -0.27245857 -0.46575645 
##          C1          C2          C3          C4          C5          C6 
## -0.28101929  0.13474768 -0.17111198  0.42876764 -0.27023027  0.24934562 
##          C7          C8          C9         C10          O1          O2 
## -0.09833812  0.37241442 -0.21750956 -0.22241830 -0.18543755  0.26289674 
##          O3          O4          O5          O6          O7          O8 
## -0.06374849  0.18506071 -0.32784841  0.21460359 -0.27776040 -0.01354644 
##          O9         O10 
##  0.03740136 -0.28769586
eigenv_fac1 = sum(loadings_fac1^2)  #SS of factor loadings
eigenv_fac1
## [1] 7.400228

That is the first eigenvalue! Cool!

We can also look at the uniquenesses.

EFAresult1$uniquenesses
##        E1        E2        E3        E4        E5        E6        E7        E8 
## 0.5152049 0.4801681 0.3960726 0.4319020 0.3941556 0.5159973 0.3967192 0.6634496 
##        E9       E10        N1        N2        N3        N4        N5        N6 
## 0.5983072 0.5158641 0.4335222 0.5769024 0.5188934 0.8061431 0.6603217 0.4256230 
##        N7        N8        N9       N10        A1        A2        A3        A4 
## 0.2950614 0.1675805 0.4679567 0.5294769 0.7335856 0.4932837 0.7018149 0.3283553 
##        A5        A6        A7        A8        A9       A10        C1        C2 
## 0.4943405 0.5620010 0.3675316 0.6337094 0.3936420 0.6449522 0.5977450 0.6007594 
##        C3        C4        C5        C6        C7        C8        C9       C10 
## 0.7518485 0.5164766 0.5718375 0.5266846 0.6908419 0.6821161 0.5893366 0.6994170 
##        O1        O2        O3        O4        O5        O6        O7        O8 
## 0.3562688 0.6018136 0.3945077 0.6899457 0.4040908 0.4957334 0.6628193 0.3671309 
##        O9       O10 
## 0.8150722 0.3778156

\(Uniqueness = 1 - Communality\) where Communality is the SS of all the factor loadings for a given variable. If all the factors jointly explain a large percent of variance in a given variable, that variable has high Communality (and thus low uniqueness).

To illustrate, lets calculate communality and uniqueness for the variable E1.

# Calculate communality
loadings_E1 = EFAresult1$loadings[1,]  #loadings for first variable (1st row of Lambda)
loadings_E1
##      Factor1      Factor2      Factor3      Factor4      Factor5      Factor6 
## -0.453254446  0.332730062  0.047301473 -0.360631214  0.095068753  0.060396148 
##      Factor7      Factor8      Factor9     Factor10 
##  0.120091807  0.007680495 -0.052817846  0.079983729
communality_E1 = sum(loadings_E1^2)  #SS of factor loadings
communality_E1
## [1] 0.4847951
# Calculate uniqueness
uniqueness_E1 = 1-communality_E1
uniqueness_E1
## [1] 0.5152049

That matches what we got above! Cool, again!

Our goal is to name the factors. Sometimes visualizations help. Plotting the factor loadings for the first two factors

#Plot loadings of the first 2 factors against one another
load = EFAresult1$loadings[,1:2] #first 2 columns of lambda
plot(load, type="n") # set up plot 
text(load, labels=names(dat_standard), cex=.7) # add variable names
abline(h = 0, v = 0) #add lines

Hard to come up with names based on what it at the high and low end of the 2 dimensions. Difficult for naming!

It can be difficult to label factors when they are unrotated, since a description of one factor might overlap with a description of another factor. For instance, Factor 1 could be conceptualized as extraverted & open vs. conscientious & neurotic, and Factor 2 could be conceptualized as agreeable & neurotic vs. agreeable & neurotic. However, that is not conceptually clean.

Factor analysis with Orthogonal rotation

We can rotate the factors to obtain more straightforward interpretations. Note that when the “best-fitting” factors are found, these factors are not unique. Any rotation of the best-fitting factors is also best-fitting. Lucky for us, fit is not compromised in the process of seeking easier interpretation.

Lots of ways to rotate. The default method in factanal() is called varimax. Varimax rotation orthogonally rotates the factor axes with the goal of maximizing the variance of the squared loadings of a factor on all the variables in the factor matrix. In other words, varimax rotation looks for a rotation (i.e., a linear combination) of the original factors that maximizes the variance of the loadings (i.e., maximizing \(variance=\Sigma(l^2_{i,f}−mean(l^{2}))\) where \(l^2_{i,f}\) is the squared loadings of the ith variable on the fth factor, and \(mean(l^2)\) is the mean of the squared loadings). As a result, each variable tends to load more heavily on a single factor (and load very little on other factors), making the interpretation of a factor easier.

#Factor analysis with rotation
EFAresult2 = factanal(~ ., data=dat_standard, 
                      factors = 10, 
                      rotation = "varimax", 
                      na.action = na.exclude)
EFAresult2
## 
## Call:
## factanal(x = ~., factors = 10, data = dat_standard, na.action = na.exclude,     rotation = "varimax")
## 
## Uniquenesses:
##    E1    E2    E3    E4    E5    E6    E7    E8    E9   E10    N1    N2    N3 
## 0.515 0.480 0.396 0.432 0.394 0.516 0.397 0.663 0.598 0.516 0.434 0.577 0.519 
##    N4    N5    N6    N7    N8    N9   N10    A1    A2    A3    A4    A5    A6 
## 0.806 0.660 0.426 0.295 0.168 0.468 0.529 0.734 0.493 0.702 0.328 0.494 0.562 
##    A7    A8    A9   A10    C1    C2    C3    C4    C5    C6    C7    C8    C9 
## 0.368 0.634 0.394 0.645 0.598 0.601 0.752 0.516 0.572 0.527 0.691 0.682 0.589 
##   C10    O1    O2    O3    O4    O5    O6    O7    O8    O9   O10 
## 0.699 0.356 0.602 0.395 0.690 0.404 0.496 0.663 0.367 0.815 0.378 
## 
## Loadings:
##     Factor1 Factor2 Factor3 Factor4 Factor5 Factor6 Factor7 Factor8 Factor9
## E1   0.660                                                   0.169         
## E2  -0.699                                                   0.114         
## E3   0.641  -0.271   0.245   0.138                           0.128         
## E4  -0.724   0.117                                           0.141         
## E5   0.728           0.198   0.104                                         
## E6  -0.598          -0.124          -0.116                   0.256         
## E7   0.728  -0.121   0.146                                   0.132         
## E8  -0.563                                                                 
## E9   0.602                                           0.125                 
## E10 -0.666   0.165                                                         
## N1  -0.101   0.732                                                  -0.101 
## N2          -0.579                                   0.114   0.224         
## N3  -0.135   0.645   0.148                                          -0.101 
## N4   0.125  -0.336                                           0.208         
## N5           0.530          -0.137                           0.152         
## N6           0.731          -0.112                                         
## N7           0.630          -0.161                                   0.525 
## N8           0.665          -0.166                                   0.597 
## N9           0.690  -0.158                                   0.103         
## N10 -0.247   0.574          -0.171                                   0.197 
## A1                  -0.409          -0.108                   0.244   0.123 
## A2   0.333           0.509                                                 
## A3           0.226  -0.399  -0.205   0.102                   0.118         
## A4                   0.810                                                 
## A5  -0.152          -0.634                                   0.208         
## A6           0.138   0.613                                   0.124         
## A7  -0.320          -0.584                                   0.205         
## A8   0.127           0.571                                                 
## A9   0.121           0.739                                                 
## A10  0.333  -0.155   0.392   0.144                   0.135   0.144         
## C1          -0.104           0.591                   0.143                 
## C2                          -0.561   0.121           0.149   0.131         
## C3                           0.399   0.148   0.119   0.175                 
## C4           0.327          -0.574                           0.153         
## C5                           0.619                           0.100         
## C6           0.144          -0.625                   0.153   0.161         
## C7                           0.531                                         
## C8           0.176  -0.137  -0.482                           0.124   0.115 
## C9                           0.613                           0.114         
## C10                          0.451   0.137           0.257                 
## O1                                   0.770   0.142   0.112                 
## O2           0.206                  -0.327  -0.237  -0.208   0.380         
## O3                                   0.171   0.739   0.119                 
## O4           0.111                  -0.233  -0.274  -0.145   0.368         
## O5   0.196                   0.147   0.202   0.282   0.637                 
## O6  -0.112                                  -0.659  -0.149   0.147         
## O7          -0.167           0.182   0.336   0.101   0.372                 
## O8                                   0.772           0.101                 
## O9  -0.127   0.156   0.175           0.235   0.182   0.141                 
## O10  0.184                           0.200   0.448   0.579                 
##     Factor10
## E1          
## E2          
## E3   0.149  
## E4          
## E5   0.101  
## E6          
## E7   0.118  
## E8          
## E9          
## E10         
## N1          
## N2          
## N3          
## N4          
## N5          
## N6          
## N7          
## N8          
## N9          
## N10         
## A1          
## A2   0.355  
## A3   0.105  
## A4          
## A5  -0.190  
## A6  -0.132  
## A7  -0.364  
## A8   0.101  
## A9  -0.141  
## A10         
## C1          
## C2   0.135  
## C3   0.102  
## C4   0.100  
## C5          
## C6          
## C7          
## C8          
## C9          
## C10         
## O1          
## O2          
## O3          
## O4          
## O5          
## O6          
## O7          
## O8          
## O9          
## O10         
## 
##                Factor1 Factor2 Factor3 Factor4 Factor5 Factor6 Factor7 Factor8
## SS loadings      5.062   4.452   3.706   3.340   1.791   1.530   1.288   0.970
## Proportion Var   0.101   0.089   0.074   0.067   0.036   0.031   0.026   0.019
## Cumulative Var   0.101   0.190   0.264   0.331   0.367   0.398   0.423   0.443
##                Factor9 Factor10
## SS loadings      0.798    0.528
## Proportion Var   0.016    0.011
## Cumulative Var   0.459    0.469
## 
## Test of the hypothesis that 10 factors are sufficient.
## The chi square statistic is 21206.81 on 770 degrees of freedom.
## The p-value is 0

And lets plot the new loadings for the first two factors.

#Plot loadings of the first 2 factors against one another
load = EFAresult2$loadings[,1:2]
plot(load, type="n") # set up plot 
text(load, labels=names(dat_standard), cex=.7) # add variable names
abline(h = 0, v = 0) #add lines

Now the variables are organized for easier interpretation. Here we can see that now all the E variables load heavily on Factor 1, but have very low loadings on Factor 2. In the vertical direction, we see that the N variable variables load heavily on Factor 2 but less so on Factor 1.

As a result, we can define or label the factors using those terms, e.g., Factor 1 might be labeled extraversion, and Factor 2 might be labeled neuroticism (labels are chosen so that higher scores are more of that construct, in this case have to look at the items).

Lets check that indeed the model is as expected. Recall that … \[ \boldsymbol{\Sigma} = \boldsymbol{\Lambda}\boldsymbol{\Psi}\boldsymbol{\Lambda}' + \boldsymbol{\Theta} \] We can pull all of the matrices from the data (to get sigma), the factanal output (for lambda, theta), or assumptions of the model fitting process (to get psi).

#Getting correlation matrix of the raw data
sigma <- cor(dat_standard, use="complete.obs")
sigma
##               E1           E2           E3           E4           E5
## E1   1.000000000 -0.421332050  0.474122844 -0.484197392  0.478953950
## E2  -0.421332050  1.000000000 -0.445967874  0.527596515 -0.539961352
## E3   0.474122844 -0.445967874  1.000000000 -0.481541735  0.590506638
## E4  -0.484197392  0.527596515 -0.481541735  1.000000000 -0.510597333
## E5   0.478953950 -0.539961352  0.590506638 -0.510597333  1.000000000
## E6  -0.346964124  0.570728872 -0.393804086  0.474796516 -0.481078590
## E7   0.588010559 -0.480247660  0.579773192 -0.503626412  0.630702775
## E8  -0.366930453  0.373305557 -0.320590041  0.446027775 -0.345126387
## E9   0.455345287 -0.365035478  0.423297190 -0.451176450  0.415973451
## E10 -0.414706073  0.463489869 -0.474495305  0.510301070 -0.542964733
## N1  -0.113951661  0.060558909 -0.235010442  0.154510643 -0.126414221
## N2   0.151135209 -0.029538701  0.281527289 -0.089374445  0.132553623
## N3  -0.119966605  0.057612457 -0.198892132  0.180292758 -0.094819549
## N4   0.135115174 -0.065851012  0.199702686 -0.114574607  0.115243882
## N5  -0.071326981  0.043865272 -0.183592488  0.128004302 -0.102082932
## N6  -0.102090404  0.041691152 -0.221480955  0.153964589 -0.119753015
## N7  -0.046212222  0.037520024 -0.210640267  0.138147325 -0.102552984
## N8  -0.055124444  0.053141489 -0.234429845  0.145008111 -0.121368243
## N9  -0.092343774  0.045854168 -0.251788702  0.148802651 -0.142114000
## N10 -0.194513383  0.188592385 -0.361071322  0.276977933 -0.240822700
## A1  -0.015434108  0.122908815 -0.116114118  0.114849263 -0.105062827
## A2   0.271922976 -0.273774390  0.425246804 -0.252476077  0.382926499
## A3   0.045047460 -0.037431117 -0.124588960  0.020240305 -0.037077433
## A4   0.086767977 -0.111554106  0.220448017 -0.056280855  0.194190369
## A5  -0.108175469  0.206724837 -0.239657102  0.158505507 -0.237087638
## A6   0.062027550 -0.058998513  0.122285209 -0.006194314  0.105602215
## A7  -0.225928921  0.300353598 -0.397239812  0.284441999 -0.356148506
## A8   0.149260989 -0.150449317  0.258018719 -0.113303687  0.244458541
## A9   0.140243073 -0.141552868  0.221204744 -0.104347424  0.226889798
## A10  0.314900037 -0.245469134  0.398293609 -0.245382216  0.391539281
## C1   0.054785399 -0.011772459  0.162452147 -0.050911686  0.111404231
## C2   0.036182970 -0.045991698 -0.034048665  0.019181138  0.008695425
## C3   0.011542252  0.024277829  0.072974997  0.024632181  0.066697443
## C4  -0.057234355  0.043898618 -0.213917037  0.161485877 -0.128537247
## C5   0.084955172 -0.023141122  0.173627213 -0.067100332  0.145572921
## C6  -0.010737659 -0.007050829 -0.095916953  0.058200767 -0.054994088
## C7  -0.031664689  0.022642981  0.028294457  0.029937386  0.027939095
## C8  -0.041535468  0.076231628 -0.181975309  0.129959204 -0.142477727
## C9   0.047188258 -0.031956849  0.145955981 -0.050969928  0.125139438
## C10  0.049017092 -0.020401336  0.111776301 -0.023388766  0.101918081
## O1   0.040272053 -0.055218322  0.031111826 -0.045260939  0.089852064
## O2  -0.025472354  0.057515149 -0.067281482  0.096859554 -0.070091821
## O3   0.071761285 -0.041844977 -0.002509103  0.026786701  0.060817443
## O4  -0.005280127  0.035192004 -0.021722821  0.060609255 -0.052450832
## O5   0.184961305 -0.128952873  0.163888788 -0.144305500  0.203171304
## O6  -0.094801032  0.104338992 -0.078249530  0.089785289 -0.108058018
## O7   0.082478559 -0.057522666  0.137607098 -0.073675461  0.123398331
## O8   0.004925744 -0.021139541 -0.073620477  0.005511235  0.014648611
## O9  -0.081113200  0.065800627 -0.088787720  0.109800662 -0.025922995
## O10  0.163392958 -0.140846382  0.121376841 -0.129292330  0.196063694
##              E6           E7            E8            E9          E10
## E1  -0.34696412  0.588010559 -0.3669304534  0.4553452870 -0.414706073
## E2   0.57072887 -0.480247660  0.3733055571 -0.3650354776  0.463489869
## E3  -0.39380409  0.579773192 -0.3205900412  0.4232971900 -0.474495305
## E4   0.47479652 -0.503626412  0.4460277750 -0.4511764498  0.510301070
## E5  -0.48107859  0.630702775 -0.3451263869  0.4159734507 -0.542964733
## E6   1.00000000 -0.405757964  0.3201932846 -0.3304710067  0.411851159
## E7  -0.40575796  1.000000000 -0.3451934390  0.4331032171 -0.533574500
## E8   0.32019328 -0.345193439  1.0000000000 -0.5147705535  0.380709268
## E9  -0.33047101  0.433103217 -0.5147705535  1.0000000000 -0.371866392
## E10  0.41185116 -0.533574500  0.3807092679 -0.3718663921  1.000000000
## N1   0.10721619 -0.140737199  0.0888159799 -0.1290780659  0.180753025
## N2  -0.05112205  0.155586903 -0.0515165061  0.1354895155 -0.093020370
## N3   0.08803358 -0.132130669  0.1119057682 -0.1119247419  0.199782749
## N4  -0.05285323  0.130321864 -0.0826436702  0.1195871679 -0.113411060
## N5   0.13813311 -0.109574021  0.0421857055 -0.0614245171  0.149259828
## N6   0.12771888 -0.143032334  0.0538386103 -0.0837609651  0.177669239
## N7   0.11193015 -0.092842129  0.0209988486 -0.0261342073  0.161698201
## N8   0.12090918 -0.113732990  0.0209483158 -0.0442917677  0.156882692
## N9   0.12154530 -0.147029385  0.0689268056 -0.0744139686  0.203749042
## N10  0.20201940 -0.241220927  0.1328205984 -0.1549157793  0.248494414
## A1   0.18690890 -0.081154751 -0.0122780146  0.0178965364  0.084839260
## A2  -0.29156642  0.356934961 -0.1722717624  0.2212747983 -0.236202423
## A3   0.01133106 -0.021247583 -0.0444530626  0.0603328734  0.053241213
## A4  -0.12338108  0.146139365 -0.0099603839  0.0445792494 -0.066398820
## A5   0.23330084 -0.179211398  0.0795844439 -0.0718747173  0.146121212
## A6  -0.01518749  0.080021444  0.0118828599  0.0055957910  0.004313070
## A7   0.33645754 -0.352594087  0.1677833016 -0.1698026775  0.253757619
## A8  -0.16590607  0.210845232  0.0027853708  0.0664074498 -0.108696926
## A9  -0.15240044  0.178828386 -0.0603485034  0.1238282736 -0.095497046
## A10 -0.24745964  0.352810323 -0.1400698373  0.2304187328 -0.244512343
## C1  -0.06397127  0.067925102  0.0087605282  0.0382823232 -0.054636695
## C2  -0.01563111  0.022439019 -0.0572400208  0.0491551219  0.015756135
## C3  -0.05183145  0.033392223  0.0562356685 -0.0001718251  0.012828766
## C4   0.11795726 -0.089067877  0.0303195024 -0.0437832399  0.134635474
## C5  -0.02267554  0.127294276 -0.0188425013  0.0505368241 -0.085062121
## C6   0.06310324 -0.039605189 -0.0073640903  0.0128333228  0.080255189
## C7  -0.01802860 -0.002246308  0.0819776625 -0.0210361536  0.035961514
## C8   0.13839389 -0.101768110  0.0282861065 -0.0242885860  0.126423130
## C9  -0.03754292  0.083699866 -0.0006181908  0.0369540099 -0.034269349
## C10 -0.08130839  0.067154679  0.0025371964  0.0645873683 -0.019190320
## O1  -0.17974286  0.056266750 -0.0251033586  0.0700464039 -0.066505859
## O2   0.18677708 -0.055346284  0.0455796593 -0.0778442624  0.103789214
## O3  -0.09306585  0.040733665 -0.0407260023  0.0873667363 -0.008828102
## O4   0.15355295 -0.035439081  0.0389979556 -0.0493286919  0.057077824
## O5  -0.23190781  0.163968676 -0.1302515957  0.2192609296 -0.141464113
## O6   0.19354983 -0.091714172  0.0979045165 -0.1190485050  0.085279534
## O7  -0.15414021  0.101124709 -0.0201984735  0.1241614502 -0.089499520
## O8  -0.10983907  0.011853671 -0.0124164787  0.0511997586 -0.008108788
## O9  -0.01514834 -0.053663616  0.0830236699 -0.0380834999  0.112695426
## O10 -0.25770782  0.164489088 -0.1172685180  0.1997084593 -0.132085604
##                N1            N2           N3           N4          N5
## E1  -0.1139516614  1.511352e-01 -0.119966605  0.135115174 -0.07132698
## E2   0.0605589085 -2.953870e-02  0.057612457 -0.065851012  0.04386527
## E3  -0.2350104420  2.815273e-01 -0.198892132  0.199702686 -0.18359249
## E4   0.1545106432 -8.937444e-02  0.180292758 -0.114574607  0.12800430
## E5  -0.1264142209  1.325536e-01 -0.094819549  0.115243882 -0.10208293
## E6   0.1072161942 -5.112205e-02  0.088033585 -0.052853233  0.13813311
## E7  -0.1407371992  1.555869e-01 -0.132130669  0.130321864 -0.10957402
## E8   0.0888159799 -5.151651e-02  0.111905768 -0.082643670  0.04218571
## E9  -0.1290780659  1.354895e-01 -0.111924742  0.119587168 -0.06142452
## E10  0.1807530249 -9.302037e-02  0.199782749 -0.113411060  0.14925983
## N1   1.0000000000 -4.646773e-01  0.553534025 -0.250989354  0.38959062
## N2  -0.4646772994  1.000000e+00 -0.396494015  0.263473005 -0.25837017
## N3   0.5535340254 -3.964940e-01  1.000000000 -0.251204884  0.31887772
## N4  -0.2509893540  2.634730e-01 -0.251204884  1.000000000 -0.13004570
## N5   0.3895906211 -2.583702e-01  0.318877723 -0.130045698  1.00000000
## N6   0.5351418971 -3.826889e-01  0.447031178 -0.211808334  0.47999563
## N7   0.4154065283 -2.949422e-01  0.355789430 -0.238041069  0.37070764
## N8   0.4336132224 -3.269564e-01  0.354108842 -0.250249655  0.39220632
## N9   0.4857225283 -3.396155e-01  0.383680791 -0.196184322  0.43232150
## N10  0.4217061092 -3.584273e-01  0.393080923 -0.393208019  0.31366407
## A1  -0.0008890883  2.268715e-02 -0.018016227  0.061695571  0.07651744
## A2  -0.0452535337  1.159194e-01  0.014837557  0.043588924 -0.07135045
## A3   0.1103327671 -6.134572e-02  0.079405307 -0.064909206  0.12553427
## A4   0.0653936259  1.859291e-02  0.141808019  0.005741134  0.01428918
## A5  -0.0042066161  5.555009e-03 -0.070715702  0.018293187  0.06127630
## A6   0.1355001737 -1.303871e-02  0.182878550 -0.010260679  0.11260601
## A7   0.0492773204 -5.086840e-02 -0.007041342 -0.013571994  0.10674782
## A8  -0.0125575663  7.116551e-02  0.063663728  0.029815256 -0.06196595
## A9   0.0604873843 -4.172108e-05  0.135685107 -0.004461244  0.02885344
## A10 -0.1350496864  1.737023e-01 -0.068933821  0.131262922 -0.10266439
## C1  -0.0848873170  8.456031e-02 -0.048820728  0.101481066 -0.15490991
## C2   0.0907545146  3.062288e-02  0.056981415 -0.051113829  0.09461437
## C3  -0.0242940872  3.970403e-02  0.097697276  0.021353859 -0.09808496
## C4   0.2613087231 -1.398266e-01  0.212940618 -0.134014077  0.26433927
## C5  -0.0984737886  4.625941e-02 -0.055639436  0.151224397 -0.10348980
## C6   0.1305898042 -1.569819e-02  0.095530451 -0.052934348  0.17051577
## C7   0.0482479633 -3.546433e-02  0.095586938  0.022670723 -0.01252093
## C8   0.1411663256 -3.917807e-02  0.102775594 -0.092282472  0.19107670
## C9   0.0068305576 -1.832232e-02  0.055191680  0.080843110 -0.07453977
## C10 -0.0489086257  2.909879e-02  0.012392057  0.063662414 -0.08522454
## O1  -0.0456112592  3.860312e-02 -0.047223880 -0.024647197 -0.11624746
## O2   0.1736815809 -7.578936e-02  0.139503855  0.011392883  0.21284280
## O3   0.0332014778  3.131265e-02  0.080795175 -0.032578689  0.01409154
## O4   0.0874191745 -3.849192e-02  0.054207111  0.055255129  0.12685188
## O5  -0.1281136824  1.329656e-01 -0.094129875  0.080498894 -0.08520357
## O6   0.0733718534 -7.076460e-02  0.037541740  0.007725755  0.08523228
## O7  -0.1744119017  1.381498e-01 -0.106412237  0.071078934 -0.15753532
## O8   0.0219782163 -2.032686e-02  0.015003441 -0.063040031 -0.03258941
## O9   0.1118983513 -5.848762e-02  0.177260586 -0.071480228  0.05220014
## O10 -0.0898931408  9.497340e-02 -0.056607451  0.039622411 -0.09066379
##               N6          N7          N8           N9          N10
## E1  -0.102090404 -0.04621222 -0.05512444 -0.092343774 -0.194513383
## E2   0.041691152  0.03752002  0.05314149  0.045854168  0.188592385
## E3  -0.221480955 -0.21064027 -0.23442984 -0.251788702 -0.361071322
## E4   0.153964589  0.13814732  0.14500811  0.148802651  0.276977933
## E5  -0.119753015 -0.10255298 -0.12136824 -0.142114000 -0.240822700
## E6   0.127718885  0.11193015  0.12090918  0.121545299  0.202019397
## E7  -0.143032334 -0.09284213 -0.11373299 -0.147029385 -0.241220927
## E8   0.053838610  0.02099885  0.02094832  0.068926806  0.132820598
## E9  -0.083760965 -0.02613421 -0.04429177 -0.074413969 -0.154915779
## E10  0.177669239  0.16169820  0.15688269  0.203749042  0.248494414
## N1   0.535141897  0.41540653  0.43361322  0.485722528  0.421706109
## N2  -0.382688910 -0.29494215 -0.32695641 -0.339615544 -0.358427343
## N3   0.447031178  0.35578943  0.35410884  0.383680791  0.393080923
## N4  -0.211808334 -0.23804107 -0.25024965 -0.196184322 -0.393208019
## N5   0.479995633  0.37070764  0.39220632  0.432321502  0.313664070
## N6   1.000000000  0.50675735  0.53995435  0.602915226  0.449473621
## N7   0.506757351  1.00000000  0.76802652  0.503533770  0.480027032
## N8   0.539954345  0.76802652  1.00000000  0.528216636  0.541434896
## N9   0.602915226  0.50353377  0.52821664  1.000000000  0.413917580
## N10  0.449473621  0.48002703  0.54143490  0.413917580  1.000000000
## A1   0.048473954  0.10987794  0.12268709  0.112921064  0.079400848
## A2  -0.075607947 -0.07308486 -0.09522488 -0.154062864 -0.138866998
## A3   0.158385667  0.21814351  0.20980857  0.311096670  0.155711789
## A4   0.057218939 -0.01746744 -0.02028971 -0.093663033 -0.015963120
## A5   0.013282685  0.06117459  0.06390833  0.124519376  0.062187309
## A6   0.175531434  0.05628123  0.05957702 -0.009611604  0.046019908
## A7   0.081259790  0.12632488  0.14464417  0.193183120  0.166779412
## A8  -0.026283377 -0.06014263 -0.07425114 -0.127407595 -0.082478468
## A9   0.080704764  0.02204906  0.02963950 -0.047728528  0.011200083
## A10 -0.125051965 -0.12146654 -0.13723801 -0.187528126 -0.187967649
## C1  -0.144929070 -0.16340524 -0.16849968 -0.118418644 -0.183933686
## C2   0.110001224  0.13172581  0.11944595  0.091863229  0.110313580
## C3  -0.071201520 -0.06466864 -0.07652301 -0.043016845 -0.048544278
## C4   0.303281871  0.32720180  0.34566672  0.281544176  0.337953477
## C5  -0.096712885 -0.13721054 -0.13106432 -0.131366243 -0.171970365
## C6   0.195028448  0.19070583  0.18543078  0.149601640  0.158532853
## C7  -0.010052823 -0.04479362 -0.06996324  0.028092632 -0.055222444
## C8   0.194569823  0.25059368  0.27958246  0.197178284  0.239823896
## C9  -0.046480862 -0.10987426 -0.11341363 -0.025915985 -0.126869687
## C10 -0.072445911 -0.09318297 -0.10178409 -0.043362105 -0.088777444
## O1  -0.092074787 -0.08619826 -0.08192127 -0.045480307 -0.004863839
## O2   0.199674123  0.13780561  0.14660959  0.169820876  0.086351421
## O3   0.036165869  0.08429730  0.06980808  0.035463011  0.074915505
## O4   0.118096966  0.06904564  0.08498748  0.118649423  0.013835282
## O5  -0.109632763 -0.07813429 -0.08766212 -0.071049822 -0.122980209
## O6   0.073422737  0.02297969  0.03471382  0.076323965  0.057780733
## O7  -0.153748485 -0.09664680 -0.11346619 -0.107871115 -0.108476307
## O8  -0.008577145  0.05696722  0.06158198  0.061323512  0.099089378
## O9   0.089475126  0.07609092  0.07150626  0.089449297  0.167901596
## O10 -0.082507878 -0.03027376 -0.04409918 -0.058721353 -0.047208847
##                A1            A2          A3           A4           A5
## E1  -0.0154341081  2.719230e-01  0.04504746  0.086767977 -0.108175469
## E2   0.1229088146 -2.737744e-01 -0.03743112 -0.111554106  0.206724837
## E3  -0.1161141184  4.252468e-01 -0.12458896  0.220448017 -0.239657102
## E4   0.1148492627 -2.524761e-01  0.02024031 -0.056280855  0.158505507
## E5  -0.1050628268  3.829265e-01 -0.03707743  0.194190369 -0.237087638
## E6   0.1869089035 -2.915664e-01  0.01133106 -0.123381085  0.233300840
## E7  -0.0811547510  3.569350e-01 -0.02124758  0.146139365 -0.179211398
## E8  -0.0122780146 -1.722718e-01 -0.04445306 -0.009960384  0.079584444
## E9   0.0178965364  2.212748e-01  0.06033287  0.044579249 -0.071874717
## E10  0.0848392598 -2.362024e-01  0.05324121 -0.066398820  0.146121212
## N1  -0.0008890883 -4.525353e-02  0.11033277  0.065393626 -0.004206616
## N2   0.0226871522  1.159194e-01 -0.06134572  0.018592913  0.005555009
## N3  -0.0180162269  1.483756e-02  0.07940531  0.141808019 -0.070715702
## N4   0.0616955705  4.358892e-02 -0.06490921  0.005741134  0.018293187
## N5   0.0765174433 -7.135045e-02  0.12553427  0.014289180  0.061276298
## N6   0.0484739541 -7.560795e-02  0.15838567  0.057218939  0.013282685
## N7   0.1098779391 -7.308486e-02  0.21814351 -0.017467436  0.061174591
## N8   0.1226870881 -9.522488e-02  0.20980857 -0.020289713  0.063908329
## N9   0.1129210645 -1.540629e-01  0.31109667 -0.093663033  0.124519376
## N10  0.0794008485 -1.388670e-01  0.15571179 -0.015963120  0.062187309
## A1   1.0000000000 -2.309679e-01  0.18930371 -0.331550922  0.339363505
## A2  -0.2309678792  1.000000e+00 -0.14986430  0.398713310 -0.418821762
## A3   0.1893037132 -1.498643e-01  1.00000000 -0.307378184  0.237601259
## A4  -0.3315509219  3.987133e-01 -0.30737818  1.000000000 -0.503091619
## A5   0.3393635046 -4.188218e-01  0.23760126 -0.503091619  1.000000000
## A6  -0.2115761064  2.529969e-01 -0.27089874  0.508659948 -0.324887098
## A7   0.3450633586 -5.744216e-01  0.24010952 -0.438008291  0.564417153
## A8  -0.2626780005  3.613309e-01 -0.19894869  0.456027484 -0.407269976
## A9  -0.2539124134  3.766339e-01 -0.24511929  0.648930491 -0.447338395
## A10 -0.1263403089  3.234225e-01 -0.21765575  0.322978199 -0.246484863
## C1  -0.0278491011  6.739869e-02 -0.11754837  0.037823372 -0.030571215
## C2  -0.0091691943  6.725398e-02  0.15326620  0.022490935 -0.015859016
## C3  -0.0230392087  8.547002e-02 -0.06456788  0.089499961 -0.050199095
## C4   0.0833310331 -4.859185e-02  0.26990267 -0.026340035  0.044130935
## C5   0.0156673009  5.569836e-02 -0.18236714  0.085553869 -0.046792314
## C6   0.0506150091  2.800457e-05  0.16501403 -0.010927887  0.023753229
## C7  -0.0711282861  1.939126e-02 -0.05244591  0.052925918 -0.010657873
## C8   0.1655414220 -1.077869e-01  0.22581350 -0.109307903  0.138430145
## C9  -0.0541220073  8.034734e-02 -0.11997799  0.101495218 -0.068542037
## C10 -0.0327002326  7.589708e-02 -0.10006350  0.074664918 -0.037756551
## O1  -0.1051777270  7.490945e-02  0.04215245 -0.006241288 -0.013194513
## O2   0.1172404010 -5.489689e-02  0.04949887 -0.011347166  0.060247401
## O3  -0.0175074543  8.415352e-02  0.06686539  0.071639445 -0.025898470
## O4   0.1196111824 -1.095028e-01  0.05475254 -0.065798358  0.123361074
## O5  -0.0224970554  1.098748e-01  0.02274156  0.026387313 -0.014555885
## O6   0.0540743588 -9.796803e-02  0.03629391 -0.064932440  0.078905004
## O7  -0.0118966238  7.514290e-02 -0.03546737  0.026091757 -0.017644205
## O8  -0.0513065090 -7.637847e-03  0.15754809 -0.067638002  0.042850306
## O9  -0.1066788355  8.657693e-02 -0.01475701  0.144349848 -0.079361030
## O10 -0.0395729058  1.366316e-01  0.04220674  0.044222998 -0.048982458
##                A6           A7           A8            A9         A10
## E1   0.0620275504 -0.225928921  0.149260989  1.402431e-01  0.31490004
## E2  -0.0589985127  0.300353598 -0.150449317 -1.415529e-01 -0.24546913
## E3   0.1222852085 -0.397239812  0.258018719  2.212047e-01  0.39829361
## E4  -0.0061943138  0.284441999 -0.113303687 -1.043474e-01 -0.24538222
## E5   0.1056022154 -0.356148506  0.244458541  2.268898e-01  0.39153928
## E6  -0.0151874888  0.336457538 -0.165906068 -1.524004e-01 -0.24745964
## E7   0.0800214442 -0.352594087  0.210845232  1.788284e-01  0.35281032
## E8   0.0118828599  0.167783302  0.002785371 -6.034850e-02 -0.14006984
## E9   0.0055957910 -0.169802678  0.066407450  1.238283e-01  0.23041873
## E10  0.0043130703  0.253757619 -0.108696926 -9.549705e-02 -0.24451234
## N1   0.1355001737  0.049277320 -0.012557566  6.048738e-02 -0.13504969
## N2  -0.0130387071 -0.050868400  0.071165508 -4.172108e-05  0.17370234
## N3   0.1828785500 -0.007041342  0.063663728  1.356851e-01 -0.06893382
## N4  -0.0102606786 -0.013571994  0.029815256 -4.461244e-03  0.13126292
## N5   0.1126060112  0.106747823 -0.061965948  2.885344e-02 -0.10266439
## N6   0.1755314342  0.081259790 -0.026283377  8.070476e-02 -0.12505197
## N7   0.0562812326  0.126324876 -0.060142629  2.204906e-02 -0.12146654
## N8   0.0595770184  0.144644174 -0.074251140  2.963950e-02 -0.13723801
## N9  -0.0096116042  0.193183120 -0.127407595 -4.772853e-02 -0.18752813
## N10  0.0460199081  0.166779412 -0.082478468  1.120008e-02 -0.18796765
## A1  -0.2115761064  0.345063359 -0.262678001 -2.539124e-01 -0.12634031
## A2   0.2529968782 -0.574421644  0.361330883  3.766339e-01  0.32342249
## A3  -0.2708987396  0.240109517 -0.198948690 -2.451193e-01 -0.21765575
## A4   0.5086599482 -0.438008291  0.456027484  6.489305e-01  0.32297820
## A5  -0.3248870984  0.564417153 -0.407269976 -4.473384e-01 -0.24648486
## A6   1.0000000000 -0.284521722  0.353459288  4.823027e-01  0.25866630
## A7  -0.2845217219  1.000000000 -0.387230512 -3.965638e-01 -0.30138915
## A8   0.3534592876 -0.387230512  1.000000000  4.298821e-01  0.32892238
## A9   0.4823026670 -0.396563761  0.429882081  1.000000e+00  0.34828311
## A10  0.2586662979 -0.301389149  0.328922379  3.482831e-01  1.00000000
## C1  -0.0033219055 -0.047684911  0.089008369  4.740521e-02  0.10651440
## C2   0.0216965025 -0.010594013 -0.002824000  1.070525e-02 -0.02805134
## C3   0.0328383175 -0.063217099  0.117114417  1.121896e-01  0.11722941
## C4  -0.0027364981  0.099566789 -0.063042039 -3.975432e-02 -0.16696416
## C5   0.0817614796 -0.058465145  0.109466482  1.091331e-01  0.16658661
## C6   0.0293990047  0.043998158 -0.036724550 -1.211277e-02 -0.07550166
## C7   0.0357799408 -0.018526583  0.066045110  3.542396e-02  0.05433777
## C8  -0.0602689770  0.167434752 -0.139705843 -9.972343e-02 -0.16450696
## C9   0.0733752746 -0.078093916  0.119966692  1.292503e-01  0.12473544
## C10  0.0430641802 -0.051490830  0.096440435  9.515950e-02  0.18694717
## O1  -0.0846257880 -0.041739671  0.016673073  9.363771e-05  0.04538956
## O2   0.0792368277  0.082851834 -0.022733358 -2.916518e-02 -0.05478836
## O3   0.0401926741 -0.042578506  0.041130536  1.003198e-01  0.07847838
## O4   0.0103377336  0.133631980 -0.052610724 -6.867928e-02 -0.03957324
## O5   0.0002254744 -0.066590154  0.063851454  8.077451e-02  0.19817183
## O6  -0.0242986833  0.133184330 -0.056278248 -9.854294e-02 -0.11304253
## O7  -0.0357469101 -0.042754525  0.073032356  6.538430e-02  0.15750753
## O8  -0.1129561031  0.041288647 -0.026188939 -3.976315e-02 -0.03429577
## O9   0.1006576656 -0.056687439  0.111984053  1.481541e-01  0.05064856
## O10  0.0062598273 -0.095938962  0.081469550  1.030149e-01  0.17354936
##               C1           C2            C3           C4          C5
## E1   0.054785399  0.036182970  0.0115422524 -0.057234355  0.08495517
## E2  -0.011772459 -0.045991698  0.0242778295  0.043898618 -0.02314112
## E3   0.162452147 -0.034048665  0.0729749969 -0.213917037  0.17362721
## E4  -0.050911686  0.019181138  0.0246321805  0.161485877 -0.06710033
## E5   0.111404231  0.008695425  0.0666974432 -0.128537247  0.14557292
## E6  -0.063971273 -0.015631112 -0.0518314488  0.117957260 -0.02267554
## E7   0.067925102  0.022439019  0.0333922235 -0.089067877  0.12729428
## E8   0.008760528 -0.057240021  0.0562356685  0.030319502 -0.01884250
## E9   0.038282323  0.049155122 -0.0001718251 -0.043783240  0.05053682
## E10 -0.054636695  0.015756135  0.0128287659  0.134635474 -0.08506212
## N1  -0.084887317  0.090754515 -0.0242940872  0.261308723 -0.09847379
## N2   0.084560314  0.030622877  0.0397040257 -0.139826566  0.04625941
## N3  -0.048820728  0.056981415  0.0976972765  0.212940618 -0.05563944
## N4   0.101481066 -0.051113829  0.0213538586 -0.134014077  0.15122440
## N5  -0.154909908  0.094614371 -0.0980849610  0.264339267 -0.10348980
## N6  -0.144929070  0.110001224 -0.0712015199  0.303281871 -0.09671289
## N7  -0.163405238  0.131725813 -0.0646686396  0.327201797 -0.13721054
## N8  -0.168499680  0.119445955 -0.0765230098  0.345666721 -0.13106432
## N9  -0.118418644  0.091863229 -0.0430168452  0.281544176 -0.13136624
## N10 -0.183933686  0.110313580 -0.0485442781  0.337953477 -0.17197037
## A1  -0.027849101 -0.009169194 -0.0230392087  0.083331033  0.01566730
## A2   0.067398685  0.067253979  0.0854700248 -0.048591850  0.05569836
## A3  -0.117548372  0.153266202 -0.0645678832  0.269902668 -0.18236714
## A4   0.037823372  0.022490935  0.0894999610 -0.026340035  0.08555387
## A5  -0.030571215 -0.015859016 -0.0501990945  0.044130935 -0.04679231
## A6  -0.003321906  0.021696502  0.0328383175 -0.002736498  0.08176148
## A7  -0.047684911 -0.010594013 -0.0632170991  0.099566789 -0.05846515
## A8   0.089008369 -0.002824000  0.1171144167 -0.063042039  0.10946648
## A9   0.047405211  0.010705249  0.1121896351 -0.039754325  0.10913307
## A10  0.106514402 -0.028051336  0.1172294137 -0.166964165  0.16658661
## C1   1.000000000 -0.260101982  0.2998418200 -0.348249839  0.38927344
## C2  -0.260101982  1.000000000 -0.1583582270  0.397591265 -0.35929748
## C3   0.299841820 -0.158358227  1.0000000000 -0.192613501  0.19948536
## C4  -0.348249839  0.397591265 -0.1926135010  1.000000000 -0.36069549
## C5   0.389273442 -0.359297482  0.1994853645 -0.360695490  1.00000000
## C6  -0.310458834  0.510228008 -0.2108306625  0.458626221 -0.38613494
## C7   0.309466955 -0.259465724  0.2494839721 -0.255198401  0.29191522
## C8  -0.317420429  0.234731332 -0.1676992121  0.389419081 -0.36577182
## C9   0.426953557 -0.265291029  0.2328662870 -0.308447674  0.42404719
## C10  0.330269966 -0.143739054  0.3378715233 -0.234082393  0.27582821
## O1   0.129099156  0.069322859  0.1502654050 -0.029885742 -0.03465213
## O2  -0.071161835  0.002978895 -0.1270633542  0.111623476  0.02529148
## O3  -0.012502672  0.094639775  0.1190112060  0.094213900 -0.06602053
## O4  -0.003185954 -0.040718948 -0.0911081266  0.038346088  0.04921620
## O5   0.200035609  0.006571500  0.1984007469 -0.129143292  0.08635175
## O6  -0.019218294 -0.024031350 -0.1039597751  0.044408232  0.02923634
## O7   0.216199784 -0.009468890  0.2394076511 -0.154962739  0.10490983
## O8   0.041781394  0.114068341  0.1002200792  0.085985373 -0.10252792
## O9   0.027067921  0.050731868  0.1351689418  0.050322704 -0.03809029
## O10  0.108975762  0.059534386  0.1771440212 -0.022950025  0.02023949
##                C6           C7          C8            C9          C10
## E1  -1.073766e-02 -0.031664689 -0.04153547  0.0471882577  0.049017092
## E2  -7.050829e-03  0.022642981  0.07623163 -0.0319568492 -0.020401336
## E3  -9.591695e-02  0.028294457 -0.18197531  0.1459559814  0.111776301
## E4   5.820077e-02  0.029937386  0.12995920 -0.0509699281 -0.023388766
## E5  -5.499409e-02  0.027939095 -0.14247773  0.1251394380  0.101918081
## E6   6.310324e-02 -0.018028604  0.13839389 -0.0375429189 -0.081308389
## E7  -3.960519e-02 -0.002246308 -0.10176811  0.0836998664  0.067154679
## E8  -7.364090e-03  0.081977662  0.02828611 -0.0006181908  0.002537196
## E9   1.283332e-02 -0.021036154 -0.02428859  0.0369540099  0.064587368
## E10  8.025519e-02  0.035961514  0.12642313 -0.0342693493 -0.019190320
## N1   1.305898e-01  0.048247963  0.14116633  0.0068305576 -0.048908626
## N2  -1.569819e-02 -0.035464330 -0.03917807 -0.0183223182  0.029098790
## N3   9.553045e-02  0.095586938  0.10277559  0.0551916804  0.012392057
## N4  -5.293435e-02  0.022670723 -0.09228247  0.0808431103  0.063662414
## N5   1.705158e-01 -0.012520930  0.19107670 -0.0745397677 -0.085224542
## N6   1.950284e-01 -0.010052823  0.19456982 -0.0464808615 -0.072445911
## N7   1.907058e-01 -0.044793620  0.25059368 -0.1098742621 -0.093182966
## N8   1.854308e-01 -0.069963242  0.27958246 -0.1134136323 -0.101784092
## N9   1.496016e-01  0.028092632  0.19717828 -0.0259159852 -0.043362105
## N10  1.585329e-01 -0.055222444  0.23982390 -0.1268696865 -0.088777444
## A1   5.061501e-02 -0.071128286  0.16554142 -0.0541220073 -0.032700233
## A2   2.800457e-05  0.019391257 -0.10778690  0.0803473409  0.075897081
## A3   1.650140e-01 -0.052445911  0.22581350 -0.1199779864 -0.100063500
## A4  -1.092789e-02  0.052925918 -0.10930790  0.1014952185  0.074664918
## A5   2.375323e-02 -0.010657873  0.13843014 -0.0685420370 -0.037756551
## A6   2.939900e-02  0.035779941 -0.06026898  0.0733752746  0.043064180
## A7   4.399816e-02 -0.018526583  0.16743475 -0.0780939164 -0.051490830
## A8  -3.672455e-02  0.066045110 -0.13970584  0.1199666924  0.096440435
## A9  -1.211277e-02  0.035423962 -0.09972343  0.1292503046  0.095159502
## A10 -7.550166e-02  0.054337766 -0.16450696  0.1247354390  0.186947172
## C1  -3.104588e-01  0.309466955 -0.31742043  0.4269535570  0.330269966
## C2   5.102280e-01 -0.259465724  0.23473133 -0.2652910292 -0.143739054
## C3  -2.108307e-01  0.249483972 -0.16769921  0.2328662870  0.337871523
## C4   4.586262e-01 -0.255198401  0.38941908 -0.3084476745 -0.234082393
## C5  -3.861349e-01  0.291915225 -0.36577182  0.4240471924  0.275828214
## C6   1.000000e+00 -0.301389685  0.30709280 -0.3186365091 -0.196668108
## C7  -3.013897e-01  1.000000000 -0.21111284  0.3966830815  0.277998409
## C8   3.070928e-01 -0.211112844  1.00000000 -0.3060686324 -0.269695973
## C9  -3.186365e-01  0.396683082 -0.30606863  1.0000000000  0.305641960
## C10 -1.966681e-01  0.277998409 -0.26969597  0.3056419597  1.000000000
## O1  -1.803740e-03  0.058795415 -0.06696161  0.0044924686  0.144662146
## O2   5.279704e-02  0.013832030  0.09332248  0.0359532076 -0.106327278
## O3   8.762565e-02 -0.016500824  0.03330274 -0.0553070413  0.046408157
## O4  -1.022032e-03  0.028343731  0.05555715  0.0626408555 -0.065888359
## O5  -2.992756e-02  0.081438345 -0.11031105  0.0858676536  0.236683664
## O6   7.382249e-03  0.030956370  0.05349323  0.0279830837 -0.058365255
## O7  -6.419744e-02  0.092316871 -0.12588876  0.0842065167  0.255020843
## O8   7.340715e-02  0.016732368  0.04088483 -0.0491517802  0.097850293
## O9   1.690205e-02  0.100944802 -0.01094459  0.0462126809  0.107625294
## O10  3.024826e-02  0.029877476 -0.05591857  0.0204470417  0.185475585
##                O1           O2           O3           O4            O5
## E1   4.027205e-02 -0.025472354  0.071761285 -0.005280127  0.1849613045
## E2  -5.521832e-02  0.057515149 -0.041844977  0.035192004 -0.1289528733
## E3   3.111183e-02 -0.067281482 -0.002509103 -0.021722821  0.1638887875
## E4  -4.526094e-02  0.096859554  0.026786701  0.060609255 -0.1443054997
## E5   8.985206e-02 -0.070091821  0.060817443 -0.052450832  0.2031713039
## E6  -1.797429e-01  0.186777083 -0.093065855  0.153552952 -0.2319078122
## E7   5.626675e-02 -0.055346284  0.040733665 -0.035439081  0.1639686764
## E8  -2.510336e-02  0.045579659 -0.040726002  0.038997956 -0.1302515957
## E9   7.004640e-02 -0.077844262  0.087366736 -0.049328692  0.2192609296
## E10 -6.650586e-02  0.103789214 -0.008828102  0.057077824 -0.1414641129
## N1  -4.561126e-02  0.173681581  0.033201478  0.087419175 -0.1281136824
## N2   3.860312e-02 -0.075789355  0.031312652 -0.038491922  0.1329656456
## N3  -4.722388e-02  0.139503855  0.080795175  0.054207111 -0.0941298755
## N4  -2.464720e-02  0.011392883 -0.032578689  0.055255129  0.0804988941
## N5  -1.162475e-01  0.212842804  0.014091543  0.126851878 -0.0852035660
## N6  -9.207479e-02  0.199674123  0.036165869  0.118096966 -0.1096327634
## N7  -8.619826e-02  0.137805606  0.084297303  0.069045643 -0.0781342929
## N8  -8.192127e-02  0.146609592  0.069808079  0.084987485 -0.0876621195
## N9  -4.548031e-02  0.169820876  0.035463011  0.118649423 -0.0710498224
## N10 -4.863839e-03  0.086351421  0.074915505  0.013835282 -0.1229802091
## A1  -1.051777e-01  0.117240401 -0.017507454  0.119611182 -0.0224970554
## A2   7.490945e-02 -0.054896890  0.084153525 -0.109502829  0.1098748271
## A3   4.215245e-02  0.049498869  0.066865385  0.054752540  0.0227415595
## A4  -6.241288e-03 -0.011347166  0.071639445 -0.065798358  0.0263873128
## A5  -1.319451e-02  0.060247401 -0.025898470  0.123361074 -0.0145558854
## A6  -8.462579e-02  0.079236828  0.040192674  0.010337734  0.0002254744
## A7  -4.173967e-02  0.082851834 -0.042578506  0.133631980 -0.0665901545
## A8   1.667307e-02 -0.022733358  0.041130536 -0.052610724  0.0638514537
## A9   9.363771e-05 -0.029165175  0.100319779 -0.068679282  0.0807745087
## A10  4.538956e-02 -0.054788358  0.078478379 -0.039573240  0.1981718324
## C1   1.290992e-01 -0.071161835 -0.012502672 -0.003185954  0.2000356094
## C2   6.932286e-02  0.002978895  0.094639775 -0.040718948  0.0065715001
## C3   1.502654e-01 -0.127063354  0.119011206 -0.091108127  0.1984007469
## C4  -2.988574e-02  0.111623476  0.094213900  0.038346088 -0.1291432921
## C5  -3.465213e-02  0.025291476 -0.066020528  0.049216204  0.0863517537
## C6  -1.803740e-03  0.052797038  0.087625655 -0.001022032 -0.0299275630
## C7   5.879542e-02  0.013832030 -0.016500824  0.028343731  0.0814383450
## C8  -6.696161e-02  0.093322478  0.033302739  0.055557145 -0.1103110527
## C9   4.492469e-03  0.035953208 -0.055307041  0.062640855  0.0858676536
## C10  1.446621e-01 -0.106327278  0.046408157 -0.065888359  0.2366836641
## O1   1.000000e+00 -0.328459620  0.241429348 -0.230202813  0.3095397259
## O2  -3.284596e-01  1.000000000 -0.214518623  0.535828360 -0.2770630494
## O3   2.414293e-01 -0.214518623  1.000000000 -0.228118323  0.2970681256
## O4  -2.302028e-01  0.535828360 -0.228118323  1.000000000 -0.1942103516
## O5   3.095397e-01 -0.277063049  0.297068126 -0.194210352  1.0000000000
## O6  -2.060375e-01  0.280578282 -0.525804338  0.282693253 -0.3307052854
## O7   3.415650e-01 -0.366813093  0.159385154 -0.193616881  0.3844585043
## O8   6.332769e-01 -0.277278795  0.214768854 -0.215187502  0.2466359831
## O9   1.993089e-01 -0.157036036  0.208655085 -0.195471393  0.1402314936
## O10  3.018820e-01 -0.311631601  0.430521335 -0.279376167  0.6242570580
##               O6          O7           O8          O9          O10
## E1  -0.094801032  0.08247856  0.004925744 -0.08111320  0.163392958
## E2   0.104338992 -0.05752267 -0.021139541  0.06580063 -0.140846382
## E3  -0.078249530  0.13760710 -0.073620477 -0.08878772  0.121376841
## E4   0.089785289 -0.07367546  0.005511235  0.10980066 -0.129292330
## E5  -0.108058018  0.12339833  0.014648611 -0.02592300  0.196063694
## E6   0.193549826 -0.15414021 -0.109839069 -0.01514834 -0.257707820
## E7  -0.091714172  0.10112471  0.011853671 -0.05366362  0.164489088
## E8   0.097904516 -0.02019847 -0.012416479  0.08302367 -0.117268518
## E9  -0.119048505  0.12416145  0.051199759 -0.03808350  0.199708459
## E10  0.085279534 -0.08949952 -0.008108788  0.11269543 -0.132085604
## N1   0.073371853 -0.17441190  0.021978216  0.11189835 -0.089893141
## N2  -0.070764599  0.13814984 -0.020326858 -0.05848762  0.094973397
## N3   0.037541740 -0.10641224  0.015003441  0.17726059 -0.056607451
## N4   0.007725755  0.07107893 -0.063040031 -0.07148023  0.039622411
## N5   0.085232276 -0.15753532 -0.032589412  0.05220014 -0.090663792
## N6   0.073422737 -0.15374849 -0.008577145  0.08947513 -0.082507878
## N7   0.022979692 -0.09664680  0.056967221  0.07609092 -0.030273764
## N8   0.034713822 -0.11346619  0.061581983  0.07150626 -0.044099175
## N9   0.076323965 -0.10787112  0.061323512  0.08944930 -0.058721353
## N10  0.057780733 -0.10847631  0.099089378  0.16790160 -0.047208847
## A1   0.054074359 -0.01189662 -0.051306509 -0.10667884 -0.039572906
## A2  -0.097968029  0.07514290 -0.007637847  0.08657693  0.136631597
## A3   0.036293911 -0.03546737  0.157548095 -0.01475701  0.042206742
## A4  -0.064932440  0.02609176 -0.067638002  0.14434985  0.044222998
## A5   0.078905004 -0.01764421  0.042850306 -0.07936103 -0.048982458
## A6  -0.024298683 -0.03574691 -0.112956103  0.10065767  0.006259827
## A7   0.133184330 -0.04275453  0.041288647 -0.05668744 -0.095938962
## A8  -0.056278248  0.07303236 -0.026188939  0.11198405  0.081469550
## A9  -0.098542944  0.06538430 -0.039763151  0.14815406  0.103014930
## A10 -0.113042527  0.15750753 -0.034295770  0.05064856  0.173549359
## C1  -0.019218294  0.21619978  0.041781394  0.02706792  0.108975762
## C2  -0.024031350 -0.00946889  0.114068341  0.05073187  0.059534386
## C3  -0.103959775  0.23940765  0.100220079  0.13516894  0.177144021
## C4   0.044408232 -0.15496274  0.085985373  0.05032270 -0.022950025
## C5   0.029236338  0.10490983 -0.102527916 -0.03809029  0.020239486
## C6   0.007382249 -0.06419744  0.073407147  0.01690205  0.030248260
## C7   0.030956370  0.09231687  0.016732368  0.10094480  0.029877476
## C8   0.053493232 -0.12588876  0.040884833 -0.01094459 -0.055918571
## C9   0.027983084  0.08420652 -0.049151780  0.04621268  0.020447042
## C10 -0.058365255  0.25502084  0.097850293  0.10762529  0.185475585
## O1  -0.206037458  0.34156495  0.633276899  0.19930887  0.301881998
## O2   0.280578282 -0.36681309 -0.277278795 -0.15703604 -0.311631601
## O3  -0.525804338  0.15938515  0.214768854  0.20865509  0.430521335
## O4   0.282693253 -0.19361688 -0.215187502 -0.19547139 -0.279376167
## O5  -0.330705285  0.38445850  0.246635983  0.14023149  0.624257058
## O6   1.000000000 -0.17518258 -0.141674007 -0.11643284 -0.430823022
## O7  -0.175182582  1.00000000  0.269713511  0.11340345  0.328895967
## O8  -0.141674007  0.26971351  1.000000000  0.19295316  0.271114163
## O9  -0.116432843  0.11340345  0.192953160  1.00000000  0.192714937
## O10 -0.430823022  0.32889597  0.271114163  0.19271494  1.000000000
#Getting the factor liading matrix
lambda <- EFAresult2$loadings[1:50, 1:10] #50 items x 10 factors
lambda
##          Factor1      Factor2      Factor3      Factor4       Factor5
## E1   0.659837960 -0.084563971  0.066168363  0.007944383  3.529024e-05
## E2  -0.698960917 -0.032287213 -0.096529279  0.022636650 -6.743050e-03
## E3   0.640563660 -0.271039505  0.244915054  0.138466399 -3.310076e-02
## E4  -0.724486428  0.116799351 -0.040230171 -0.030048428  1.856336e-02
## E5   0.727590273 -0.081120629  0.197770248  0.103716796  4.123486e-02
## E6  -0.598220489  0.045161894 -0.124122139 -0.040443349 -1.158912e-01
## E7   0.728079507 -0.120936335  0.146380475  0.052990320  2.756420e-02
## E8  -0.563369123  0.030437836  0.028483996  0.063606487  2.692321e-02
## E9   0.602261836 -0.069186584  0.010492744 -0.018795472  2.856074e-02
## E10 -0.666365208  0.164816413 -0.046678571 -0.036115428 -1.782109e-02
## N1  -0.100861622  0.731932792  0.050387218 -0.030251856 -2.493498e-03
## N2   0.082612997 -0.578632415  0.036313013 -0.039048107  9.839713e-03
## N3  -0.134985608  0.644931733  0.148324808  0.033459035  3.064452e-03
## N4   0.124931794 -0.335747904 -0.009768606  0.085299980 -6.475451e-02
## N5  -0.060979170  0.530064198 -0.007970757 -0.136959472 -9.051610e-02
## N6  -0.072237073  0.731349435  0.041048901 -0.111804071 -5.894574e-02
## N7  -0.033619059  0.629577825 -0.054677486 -0.161383363 -2.038776e-02
## N8  -0.041630291  0.665145268 -0.057732315 -0.165885743 -1.368153e-02
## N9  -0.065714282  0.690342502 -0.157803876 -0.075251148  6.185507e-03
## N10 -0.247001480  0.573548324 -0.024619293 -0.171183408  7.844775e-02
## A1  -0.052918052  0.024084388 -0.409342977 -0.035276794 -1.076219e-01
## A2   0.332953935 -0.070475113  0.509027102  0.017924453  3.913519e-02
## A3   0.073572966  0.225681028 -0.399041526 -0.204892272  1.022361e-01
## A4   0.050085821  0.045661444  0.809692164  0.036013204  3.248286e-03
## A5  -0.152197296  0.001100411 -0.633560851 -0.013111015  6.120068e-03
## A6   0.006028869  0.138461415  0.613114921  0.021930133 -9.227338e-02
## A7  -0.320197096  0.076710354 -0.584433067 -0.036102697  1.120183e-02
## A8   0.127318795 -0.033940979  0.570685090  0.092388446  2.373357e-02
## A9   0.120861036  0.083946823  0.738800819  0.059017331  6.988468e-03
## A10  0.333329466 -0.155124820  0.391744297  0.144444988  1.541150e-03
## C1   0.031879441 -0.103753602  0.018777598  0.590941863  9.770512e-02
## C2   0.035399112  0.082515551  0.049053858 -0.560757224  1.210213e-01
## C3  -0.040607679 -0.006465014  0.090069043  0.399372497  1.476516e-01
## C4  -0.083922556  0.326919728 -0.034940938 -0.573885129  5.289667e-02
## C5   0.076828449 -0.091807878  0.076213211  0.618870986 -8.263988e-02
## C6  -0.021041019  0.144197413  0.015612489 -0.624722180  4.820167e-02
## C7  -0.047505593  0.087126956  0.025132192  0.530962016  5.621576e-02
## C8  -0.081525085  0.176162442 -0.137121629 -0.482189178 -4.565707e-03
## C9   0.047974732  0.034602373  0.092467329  0.612558236 -1.457115e-02
## C10  0.022657453 -0.020235964  0.072467161  0.450827893  1.373568e-01
## O1   0.062927801 -0.049021277 -0.014227501  0.054713233  7.702943e-01
## O2  -0.051288522  0.205851674 -0.022665961 -0.024306765 -3.271121e-01
## O3   0.032382270  0.074712323  0.044795273 -0.062113761  1.708800e-01
## O4  -0.017584846  0.110912912 -0.097432605  0.041341326 -2.334327e-01
## O5   0.195853278 -0.085259105 -0.002528613  0.146544231  2.017832e-01
## O6  -0.111890574  0.059887927 -0.056970539  0.002919437 -8.300110e-02
## O7   0.077969194 -0.167194382  0.024724778  0.181652527  3.364170e-01
## O8   0.021832555  0.062049601 -0.087835741 -0.047129863  7.721527e-01
## O9  -0.127285784  0.156459925  0.174916292  0.043015527  2.347292e-01
## O10  0.184011580 -0.040514588  0.025519506  0.039255318  1.996020e-01
##           Factor6      Factor7      Factor8      Factor9     Factor10
## E1   0.0582558743  0.047444424  0.169413396  0.057569318  0.012517738
## E2   0.0012283336 -0.010798372  0.113654436  0.074672780 -0.041904221
## E3  -0.0125813538  0.027229999  0.127602793  0.021199108  0.149196030
## E4   0.0419043753 -0.003802417  0.140906087  0.054409631  0.046085422
## E5   0.0323631895  0.045306634  0.069396478 -0.009735316  0.101463880
## E6  -0.0695308847 -0.098657069  0.256403904  0.091334503 -0.070500600
## E7   0.0332188853 -0.003303071  0.131776715  0.035249112  0.117639409
## E8  -0.0311043501 -0.029224171  0.049789067 -0.014479293  0.090257325
## E9   0.0648369724  0.124826696  0.080640765  0.050253041 -0.063980207
## E10 -0.0016866436  0.035729497  0.079756201  0.025312962  0.029096020
## N1  -0.0088717063 -0.066825163  0.032425788 -0.101260072  0.035633399
## N2   0.0488708837  0.113772568  0.224130666  0.098568571  0.056865601
## N3   0.0502786509 -0.037379907  0.054634596 -0.100839613  0.082102885
## N4  -0.0322985637  0.082863917  0.207834909 -0.037063826 -0.038479911
## N5  -0.0343602856  0.010753059  0.151540186  0.020601316 -0.057375069
## N6  -0.0306623171  0.015340409  0.098957407  0.057594214 -0.048391685
## N7   0.0285979963  0.020812012  0.031676721  0.524722199  0.020051750
## N8   0.0085443221  0.008080320  0.008241519  0.596961760 -0.025694870
## N9  -0.0347797942  0.046749266  0.103174326  0.080646004 -0.002335210
## N10  0.0364360872 -0.034276664 -0.042102633  0.196964798 -0.037699813
## A1   0.0147374521  0.047305160  0.243596012  0.122956011 -0.075705527
## A2   0.0565553288  0.027139848 -0.001736949  0.014432447  0.354659246
## A3   0.0133089782  0.064564856  0.118016265  0.029449045  0.105019511
## A4   0.0359056067  0.008065885  0.044122553  0.002716266 -0.082669155
## A5  -0.0005420926  0.035289573  0.207682356  0.021756417 -0.189828875
## A6   0.0209775068  0.025978077  0.123834669 -0.000769383 -0.132042323
## A7  -0.0424236656  0.047291433  0.205200262  0.049453244 -0.363975291
## A8   0.0122913127  0.040793469  0.046187681  0.008012174  0.100674547
## A9   0.0681427769  0.069827251  0.060496474  0.047122434 -0.141229620
## A10  0.0679453546  0.135183517  0.143804106  0.040731656 -0.017762793
## C1  -0.0233912158  0.143445444  0.065930355 -0.005319610  0.076576414
## C2  -0.0063681081  0.149400400  0.131348826 -0.042752003  0.135056716
## C3   0.1193285966  0.175314634  0.041692759  0.002629638  0.101624487
## C4   0.0203797993  0.014591174  0.152775271  0.046814449  0.100402691
## C5  -0.0292026496  0.009146353  0.100230137  0.057076742 -0.062860948
## C6  -0.0143078321  0.152554067  0.161408827 -0.029900438  0.093875435
## C7  -0.0183859909  0.038749367  0.056700531 -0.058477659  0.071568166
## C8   0.0088491708 -0.016927416  0.123509968  0.115081046 -0.003142324
## C9  -0.0508655060  0.040947704  0.114239945 -0.052674899  0.055538847
## C10  0.0141099379  0.256719871  0.059687671 -0.014012093  0.049332595
## O1   0.1419254969  0.111756647 -0.070439535 -0.054767584  0.015019426
## O2  -0.2369282427 -0.207509124  0.379608656 -0.015355701  0.039213701
## O3   0.7392580540  0.118796326  0.052027027  0.012237167  0.018045061
## O4  -0.2742219354 -0.145463027  0.367599505 -0.005033794 -0.015283119
## O5   0.2822947541  0.637435810 -0.036029501 -0.011762852 -0.025136461
## O6  -0.6588591782 -0.148592470  0.147369813 -0.006617563  0.008909692
## O7   0.1009663294  0.372050341 -0.056795353  0.067101394 -0.004256968
## O8   0.0954579762  0.100875441 -0.047688232  0.028540662 -0.003227647
## O9   0.1817076118  0.140661633 -0.035917677 -0.023144424  0.045540192
## O10  0.4483705197  0.578913732 -0.090026313 -0.012017704  0.014942558
#Getting the factor correlation matrix
psi <- diag(1, nrow=10, ncol=10)   #10 orthogonal factors
psi
##       [,1] [,2] [,3] [,4] [,5] [,6] [,7] [,8] [,9] [,10]
##  [1,]    1    0    0    0    0    0    0    0    0     0
##  [2,]    0    1    0    0    0    0    0    0    0     0
##  [3,]    0    0    1    0    0    0    0    0    0     0
##  [4,]    0    0    0    1    0    0    0    0    0     0
##  [5,]    0    0    0    0    1    0    0    0    0     0
##  [6,]    0    0    0    0    0    1    0    0    0     0
##  [7,]    0    0    0    0    0    0    1    0    0     0
##  [8,]    0    0    0    0    0    0    0    1    0     0
##  [9,]    0    0    0    0    0    0    0    0    1     0
## [10,]    0    0    0    0    0    0    0    0    0     1
#Getting the uniquenesses matrix
theta <- diag(EFAresult2$uniquenesses)
theta
##            [,1]      [,2]      [,3]     [,4]      [,5]      [,6]      [,7]
##  [1,] 0.5152049 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
##  [2,] 0.0000000 0.4801681 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
##  [3,] 0.0000000 0.0000000 0.3960726 0.000000 0.0000000 0.0000000 0.0000000
##  [4,] 0.0000000 0.0000000 0.0000000 0.431902 0.0000000 0.0000000 0.0000000
##  [5,] 0.0000000 0.0000000 0.0000000 0.000000 0.3941556 0.0000000 0.0000000
##  [6,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.5159973 0.0000000
##  [7,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.3967192
##  [8,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
##  [9,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [10,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [11,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [12,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [13,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [14,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [15,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [16,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [17,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [18,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [19,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [20,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [21,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [22,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [23,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [24,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [25,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [26,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [27,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [28,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [29,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [30,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [31,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [32,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [33,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [34,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [35,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [36,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [37,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [38,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [39,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [40,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [41,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [42,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [43,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [44,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [45,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [46,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [47,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [48,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [49,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
## [50,] 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000
##            [,8]      [,9]     [,10]     [,11]     [,12]     [,13]     [,14]
##  [1,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [2,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [3,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [4,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [5,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [6,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [7,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [8,] 0.6634496 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [9,] 0.0000000 0.5983072 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [10,] 0.0000000 0.0000000 0.5158641 0.0000000 0.0000000 0.0000000 0.0000000
## [11,] 0.0000000 0.0000000 0.0000000 0.4335222 0.0000000 0.0000000 0.0000000
## [12,] 0.0000000 0.0000000 0.0000000 0.0000000 0.5769024 0.0000000 0.0000000
## [13,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.5188934 0.0000000
## [14,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.8061431
## [15,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [16,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [17,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [18,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [19,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [20,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [21,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [22,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [23,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [24,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [25,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [26,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [27,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [28,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [29,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [30,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [31,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [32,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [33,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [34,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [35,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [36,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [37,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [38,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [39,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [40,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [41,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [42,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [43,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [44,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [45,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [46,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [47,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [48,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [49,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [50,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##           [,15]    [,16]     [,17]     [,18]     [,19]     [,20]     [,21]
##  [1,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [2,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [3,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [4,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [5,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [6,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [7,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [8,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [9,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [10,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [11,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [12,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [13,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [14,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [15,] 0.6603217 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [16,] 0.0000000 0.425623 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [17,] 0.0000000 0.000000 0.2950614 0.0000000 0.0000000 0.0000000 0.0000000
## [18,] 0.0000000 0.000000 0.0000000 0.1675805 0.0000000 0.0000000 0.0000000
## [19,] 0.0000000 0.000000 0.0000000 0.0000000 0.4679567 0.0000000 0.0000000
## [20,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.5294769 0.0000000
## [21,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.7335856
## [22,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [23,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [24,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [25,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [26,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [27,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [28,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [29,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [30,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [31,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [32,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [33,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [34,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [35,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [36,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [37,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [38,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [39,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [40,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [41,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [42,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [43,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [44,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [45,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [46,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [47,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [48,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [49,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [50,] 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##           [,22]     [,23]     [,24]     [,25]    [,26]     [,27]     [,28]
##  [1,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [2,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [3,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [4,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [5,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [6,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [7,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [8,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [9,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [10,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [11,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [12,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [13,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [14,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [15,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [16,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [17,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [18,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [19,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [20,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [21,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [22,] 0.4932837 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [23,] 0.0000000 0.7018149 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [24,] 0.0000000 0.0000000 0.3283553 0.0000000 0.000000 0.0000000 0.0000000
## [25,] 0.0000000 0.0000000 0.0000000 0.4943405 0.000000 0.0000000 0.0000000
## [26,] 0.0000000 0.0000000 0.0000000 0.0000000 0.562001 0.0000000 0.0000000
## [27,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.3675316 0.0000000
## [28,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.6337094
## [29,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [30,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [31,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [32,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [33,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [34,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [35,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [36,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [37,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [38,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [39,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [40,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [41,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [42,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [43,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [44,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [45,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [46,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [47,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [48,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [49,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [50,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##          [,29]     [,30]    [,31]     [,32]     [,33]     [,34]     [,35]
##  [1,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [2,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [3,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [4,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [5,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [6,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [7,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [8,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [9,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [10,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [11,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [12,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [13,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [14,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [15,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [16,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [17,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [18,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [19,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [20,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [21,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [22,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [23,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [24,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [25,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [26,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [27,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [28,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [29,] 0.393642 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [30,] 0.000000 0.6449522 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [31,] 0.000000 0.0000000 0.597745 0.0000000 0.0000000 0.0000000 0.0000000
## [32,] 0.000000 0.0000000 0.000000 0.6007594 0.0000000 0.0000000 0.0000000
## [33,] 0.000000 0.0000000 0.000000 0.0000000 0.7518485 0.0000000 0.0000000
## [34,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.5164766 0.0000000
## [35,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.5718375
## [36,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [37,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [38,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [39,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [40,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [41,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [42,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [43,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [44,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [45,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [46,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [47,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [48,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [49,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
## [50,] 0.000000 0.0000000 0.000000 0.0000000 0.0000000 0.0000000 0.0000000
##           [,36]     [,37]     [,38]     [,39]    [,40]     [,41]     [,42]
##  [1,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [2,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [3,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [4,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [5,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [6,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [7,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [8,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##  [9,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [10,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [11,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [12,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [13,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [14,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [15,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [16,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [17,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [18,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [19,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [20,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [21,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [22,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [23,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [24,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [25,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [26,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [27,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [28,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [29,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [30,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [31,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [32,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [33,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [34,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [35,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [36,] 0.5266846 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [37,] 0.0000000 0.6908419 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [38,] 0.0000000 0.0000000 0.6821161 0.0000000 0.000000 0.0000000 0.0000000
## [39,] 0.0000000 0.0000000 0.0000000 0.5893366 0.000000 0.0000000 0.0000000
## [40,] 0.0000000 0.0000000 0.0000000 0.0000000 0.699417 0.0000000 0.0000000
## [41,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.3562688 0.0000000
## [42,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.6018136
## [43,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [44,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [45,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [46,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [47,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [48,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [49,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
## [50,] 0.0000000 0.0000000 0.0000000 0.0000000 0.000000 0.0000000 0.0000000
##           [,43]     [,44]     [,45]     [,46]     [,47]     [,48]     [,49]
##  [1,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [2,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [3,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [4,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [5,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [6,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [7,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [8,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##  [9,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [10,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [11,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [12,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [13,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [14,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [15,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [16,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [17,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [18,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [19,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [20,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [21,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [22,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [23,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [24,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [25,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [26,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [27,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [28,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [29,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [30,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [31,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [32,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [33,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [34,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [35,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [36,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [37,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [38,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [39,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [40,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [41,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [42,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [43,] 0.3945077 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [44,] 0.0000000 0.6899457 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
## [45,] 0.0000000 0.0000000 0.4040908 0.0000000 0.0000000 0.0000000 0.0000000
## [46,] 0.0000000 0.0000000 0.0000000 0.4957334 0.0000000 0.0000000 0.0000000
## [47,] 0.0000000 0.0000000 0.0000000 0.0000000 0.6628193 0.0000000 0.0000000
## [48,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.3671309 0.0000000
## [49,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.8150722
## [50,] 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000 0.0000000
##           [,50]
##  [1,] 0.0000000
##  [2,] 0.0000000
##  [3,] 0.0000000
##  [4,] 0.0000000
##  [5,] 0.0000000
##  [6,] 0.0000000
##  [7,] 0.0000000
##  [8,] 0.0000000
##  [9,] 0.0000000
## [10,] 0.0000000
## [11,] 0.0000000
## [12,] 0.0000000
## [13,] 0.0000000
## [14,] 0.0000000
## [15,] 0.0000000
## [16,] 0.0000000
## [17,] 0.0000000
## [18,] 0.0000000
## [19,] 0.0000000
## [20,] 0.0000000
## [21,] 0.0000000
## [22,] 0.0000000
## [23,] 0.0000000
## [24,] 0.0000000
## [25,] 0.0000000
## [26,] 0.0000000
## [27,] 0.0000000
## [28,] 0.0000000
## [29,] 0.0000000
## [30,] 0.0000000
## [31,] 0.0000000
## [32,] 0.0000000
## [33,] 0.0000000
## [34,] 0.0000000
## [35,] 0.0000000
## [36,] 0.0000000
## [37,] 0.0000000
## [38,] 0.0000000
## [39,] 0.0000000
## [40,] 0.0000000
## [41,] 0.0000000
## [42,] 0.0000000
## [43,] 0.0000000
## [44,] 0.0000000
## [45,] 0.0000000
## [46,] 0.0000000
## [47,] 0.0000000
## [48,] 0.0000000
## [49,] 0.0000000
## [50,] 0.3778156

We do the multiplication and addition on the right side of the equation.

rightside <- lambda %*% psi %*% t(lambda) + theta

And check the difference

diff <- sigma - rightside
round(diff, 2)
##        E1    E2    E3    E4    E5    E6    E7    E8    E9   E10    N1    N2
## E1   0.00  0.02 -0.01 -0.02 -0.04  0.02  0.06  0.00  0.03  0.03  0.01 -0.01
## E2   0.02  0.00  0.00  0.00 -0.02  0.10  0.03 -0.02  0.04 -0.01  0.02 -0.02
## E3  -0.01  0.00  0.00  0.00  0.02  0.01  0.00  0.01  0.02  0.00  0.01  0.03
## E4  -0.02  0.00  0.00  0.00  0.02  0.00  0.02  0.03 -0.02 -0.01  0.00  0.00
## E5  -0.04 -0.02  0.02  0.02  0.00 -0.01  0.03  0.04 -0.04 -0.04  0.00 -0.01
## E6   0.02  0.10  0.01  0.00 -0.01  0.00  0.03 -0.02  0.02 -0.02  0.01 -0.02
## E7   0.06  0.03  0.00  0.02  0.03  0.03  0.00  0.04 -0.02 -0.03  0.01 -0.02
## E8   0.00 -0.02  0.01  0.03  0.04 -0.02  0.04  0.00 -0.17  0.00  0.00  0.00
## E9   0.03  0.04  0.02 -0.02 -0.04  0.02 -0.02 -0.17  0.00  0.03 -0.01  0.01
## E10  0.03 -0.01  0.00 -0.01 -0.04 -0.02 -0.03  0.00  0.03  0.00  0.00  0.03
## N1   0.01  0.02  0.01  0.00  0.00  0.01  0.01  0.00 -0.01  0.00  0.00 -0.03
## N2  -0.01 -0.02  0.03  0.00 -0.01 -0.02 -0.02  0.00  0.01  0.03 -0.03  0.00
## N3   0.01  0.00  0.01  0.01  0.01  0.00  0.01  0.00  0.02  0.01  0.04 -0.02
## N4  -0.01 -0.01 -0.01 -0.01 -0.02 -0.01 -0.02 -0.01  0.00  0.01  0.01  0.01
## N5  -0.01  0.00  0.01  0.00  0.00  0.01  0.00  0.00  0.00  0.00 -0.01  0.02
## N6  -0.01  0.00  0.02  0.00  0.00  0.01 -0.01  0.00  0.00  0.00 -0.01  0.02
## N7   0.00 -0.01  0.00  0.00  0.00  0.00  0.00  0.00  0.00  0.01  0.00  0.00
## N8   0.00  0.00  0.00  0.00  0.00 -0.01  0.00  0.00 -0.01  0.00  0.00  0.00
## N9   0.00 -0.01  0.01 -0.01 -0.01  0.00  0.00  0.02  0.00  0.02 -0.01  0.03
## N10  0.02  0.02 -0.01  0.02  0.01  0.02  0.02 -0.01  0.02 -0.02 -0.01 -0.02
## A1   0.00  0.01  0.00  0.02  0.01  0.02  0.00 -0.03  0.02  0.00  0.01 -0.01
## A2   0.00  0.02  0.01  0.00 -0.01  0.01 -0.01 -0.03  0.02  0.01  0.01  0.00
## A3   0.02 -0.02 -0.01  0.00  0.00 -0.02 -0.01  0.00  0.02  0.03 -0.03  0.03
## A4  -0.01 -0.01  0.00  0.00  0.00 -0.01  0.00  0.00  0.00  0.00  0.00  0.00
## A5   0.00  0.01  0.02  0.00  0.00  0.00  0.02  0.02 -0.01  0.00  0.02  0.00
## A6   0.01 -0.01  0.00  0.00  0.00  0.01  0.00  0.00 -0.01  0.01  0.01  0.02
## A7   0.00 -0.02  0.00  0.01  0.02 -0.01 -0.01  0.03 -0.01 -0.01  0.00  0.01
## A8   0.01 -0.01 -0.01  0.00  0.01 -0.01  0.01  0.04 -0.02  0.00  0.00  0.00
## A9   0.00  0.00 -0.01  0.00  0.00 -0.01 -0.01 -0.01  0.02  0.00 -0.01 -0.01
## A10  0.02  0.00  0.01  0.01  0.03 -0.01  0.01  0.03 -0.02  0.01  0.01 -0.01
## C1   0.00 -0.01  0.01 -0.01 -0.01  0.00 -0.02 -0.02  0.00  0.00  0.02  0.01
## C2  -0.01  0.00  0.00  0.00  0.00 -0.01 -0.01 -0.02  0.00 -0.01  0.01  0.00
## C3   0.00  0.00  0.00 -0.01  0.01 -0.01  0.00  0.00  0.00  0.00 -0.01  0.01
## C4   0.00 -0.01 -0.02  0.01  0.00  0.00  0.01 -0.01  0.01 -0.01  0.00 -0.01
## C5   0.00  0.00 -0.01  0.01  0.01  0.02  0.01 -0.01  0.00  0.00  0.00 -0.02
## C6  -0.01 -0.01  0.00 -0.02  0.00  0.01 -0.01  0.00  0.00  0.00  0.00 -0.01
## C7  -0.01 -0.02 -0.01 -0.01 -0.01 -0.02  0.00  0.01  0.02  0.00 -0.01  0.02
## C8   0.01  0.00  0.00  0.01  0.00  0.00  0.00  0.01  0.02  0.01  0.00  0.02
## C9  -0.01 -0.01 -0.01 -0.01  0.00  0.00 -0.01 -0.03  0.02  0.01 -0.01 -0.01
## C10  0.00 -0.01 -0.01  0.00  0.00 -0.01  0.00 -0.02  0.02  0.01 -0.01 -0.02
## O1   0.00  0.00  0.01  0.00  0.00 -0.01 -0.01  0.00 -0.01  0.00  0.01  0.00
## O2  -0.01 -0.02 -0.03 -0.01 -0.01 -0.03 -0.03 -0.01 -0.01  0.00 -0.01  0.00
## O3   0.00 -0.02  0.00  0.00  0.00  0.00 -0.02  0.00  0.00  0.00 -0.01  0.00
## O4  -0.02 -0.03 -0.01  0.00 -0.01 -0.03 -0.03  0.00 -0.02  0.00 -0.01 -0.02
## O5   0.01  0.01  0.00  0.01  0.00  0.01  0.00  0.00  0.00 -0.01  0.01  0.00
## O6   0.01  0.01  0.00  0.01  0.01  0.01  0.01  0.00  0.01 -0.01  0.00 -0.01
## O7   0.00  0.00  0.02  0.00  0.00  0.00  0.01  0.03  0.01 -0.01  0.00  0.00
## O8   0.00  0.00 -0.01  0.00 -0.01  0.00  0.00 -0.01  0.00  0.00  0.00  0.00
## O9  -0.01  0.01 -0.01  0.00  0.02 -0.01  0.02  0.00  0.02  0.01 -0.01  0.02
## O10  0.00  0.01 -0.01  0.00  0.01  0.00  0.01  0.01 -0.01 -0.01  0.00 -0.01
##        N3    N4    N5    N6    N7    N8    N9   N10    A1    A2    A3    A4
## E1   0.01 -0.01 -0.01 -0.01  0.00  0.00  0.00  0.02  0.00  0.00  0.02 -0.01
## E2   0.00 -0.01  0.00  0.00 -0.01  0.00 -0.01  0.02  0.01  0.02 -0.02 -0.01
## E3   0.01 -0.01  0.01  0.02  0.00  0.00  0.01 -0.01  0.00  0.01 -0.01  0.00
## E4   0.01 -0.01  0.00  0.00  0.00  0.00 -0.01  0.02  0.02  0.00  0.00  0.00
## E5   0.01 -0.02  0.00  0.00  0.00  0.00 -0.01  0.01  0.01 -0.01  0.00  0.00
## E6   0.00 -0.01  0.01  0.01  0.00 -0.01  0.00  0.02  0.02  0.01 -0.02 -0.01
## E7   0.01 -0.02  0.00 -0.01  0.00  0.00  0.00  0.02  0.00 -0.01 -0.01  0.00
## E8   0.00 -0.01  0.00  0.00  0.00  0.00  0.02 -0.01 -0.03 -0.03  0.00  0.00
## E9   0.02  0.00  0.00  0.00  0.00 -0.01  0.00  0.02  0.02  0.02  0.02  0.00
## E10  0.01  0.01  0.00  0.00  0.01  0.00  0.02 -0.02  0.00  0.01  0.03  0.00
## N1   0.04  0.01 -0.01 -0.01  0.00  0.00 -0.01 -0.01  0.01  0.01 -0.03  0.00
## N2  -0.02  0.01  0.02  0.02  0.00  0.00  0.03 -0.02 -0.01  0.00  0.03  0.00
## N3   0.00 -0.03 -0.02 -0.03  0.01  0.00 -0.04  0.02  0.03  0.00  0.00  0.00
## N4  -0.03  0.00  0.03  0.03  0.00  0.01  0.03 -0.13  0.02  0.00  0.00  0.01
## N5  -0.02  0.03  0.00  0.05  0.00  0.00  0.03 -0.02  0.00  0.02 -0.02 -0.01
## N6  -0.03  0.03  0.05  0.00  0.00  0.00  0.07 -0.01  0.00  0.00 -0.01 -0.01
## N7   0.01  0.00  0.00  0.00  0.00  0.00  0.00 -0.02 -0.01  0.00  0.00  0.00
## N8   0.00  0.01  0.00  0.00  0.00  0.00  0.00  0.00  0.00  0.00 -0.01  0.00
## N9  -0.04  0.03  0.03  0.07  0.00  0.00  0.00 -0.02 -0.01  0.00  0.06  0.00
## N10  0.02 -0.13 -0.02 -0.01 -0.02  0.00 -0.02  0.00  0.03  0.01  0.00 -0.01
## A1   0.03  0.02  0.00  0.00 -0.01  0.00 -0.01  0.03  0.00  0.02  0.00 -0.02
## A2   0.00  0.00  0.02  0.00  0.00  0.00  0.00  0.01  0.02  0.00  0.00  0.00
## A3   0.00  0.00 -0.02 -0.01  0.00 -0.01  0.06  0.00  0.00  0.00  0.00  0.01
## A4   0.00  0.01 -0.01 -0.01  0.00  0.00  0.00 -0.01 -0.02  0.00  0.01  0.00
## A5   0.01 -0.02  0.00 -0.01  0.00  0.00 -0.01  0.00  0.00  0.02 -0.02 -0.01
## A6   0.01  0.00  0.01  0.03  0.00  0.00 -0.02 -0.01 -0.01  0.00 -0.05 -0.01
## A7   0.02 -0.01 -0.02 -0.02  0.00  0.00 -0.01  0.01  0.00 -0.03  0.01  0.01
## A8   0.01 -0.01 -0.02  0.00  0.00  0.00 -0.01  0.00 -0.02 -0.01  0.02 -0.01
## A9   0.00 -0.01 -0.01 -0.01  0.00  0.00  0.01  0.01  0.02  0.01  0.03  0.02
## A10  0.01 -0.01  0.00  0.00  0.00  0.00 -0.01  0.02  0.01  0.00 -0.05 -0.02
## C1   0.00  0.00 -0.02  0.00  0.00  0.01 -0.01 -0.01  0.00  0.00  0.00  0.01
## C2   0.00 -0.01 -0.03 -0.01  0.01  0.00 -0.01 -0.01 -0.02 -0.01 -0.01  0.00
## C3   0.06 -0.01 -0.03 -0.02  0.00  0.00 -0.01  0.01  0.03 -0.01  0.01  0.00
## C4   0.00  0.01 -0.01 -0.01 -0.01  0.00 -0.02  0.03  0.01 -0.01  0.03  0.01
## C5  -0.01  0.03  0.01  0.02 -0.01  0.00 -0.02  0.01  0.03  0.00 -0.01 -0.01
## C6   0.01  0.01 -0.01  0.01  0.01  0.00 -0.02 -0.02  0.00 -0.02 -0.03 -0.01
## C7   0.00  0.00  0.01 -0.02  0.01  0.00  0.00 -0.01 -0.04 -0.01  0.03  0.02
## C8   0.02  0.00  0.00 -0.01 -0.01  0.00 -0.01  0.01  0.04  0.01  0.02  0.01
## C9  -0.01  0.01 -0.02 -0.01  0.00  0.00  0.00 -0.01 -0.01 -0.01  0.01  0.00
## C10  0.00 -0.01 -0.01 -0.01  0.00  0.00  0.00  0.01  0.01 -0.01 -0.02  0.00
## O1  -0.02  0.00  0.01  0.01 -0.01  0.00  0.00 -0.01  0.00  0.01 -0.03  0.00
## O2  -0.02  0.00  0.01 -0.01  0.00  0.01 -0.02  0.00 -0.01  0.01 -0.01  0.00
## O3   0.00  0.01  0.00  0.00  0.00  0.00  0.00 -0.01 -0.01  0.00  0.01  0.00
## O4  -0.02  0.00 -0.01 -0.01  0.00  0.01 -0.01 -0.01 -0.03 -0.01  0.00  0.00
## O5  -0.01 -0.01  0.02  0.00  0.00  0.00 -0.01 -0.01 -0.01  0.01  0.00  0.00
## O6   0.01  0.00  0.00 -0.01  0.00  0.00 -0.01  0.03  0.00  0.01  0.02  0.00
## O7   0.02  0.00  0.00  0.01  0.00 -0.01  0.01  0.01  0.04 -0.01 -0.01  0.00
## O8  -0.01  0.01  0.01  0.00  0.00  0.00  0.00 -0.01  0.00  0.00  0.02  0.00
## O9   0.02  0.01  0.00 -0.01  0.00  0.00  0.01  0.04 -0.01  0.01  0.00  0.00
## O10 -0.01  0.00 -0.01 -0.01  0.00  0.00 -0.01  0.02 -0.01  0.00  0.00  0.00
##        A5    A6    A7    A8    A9   A10    C1    C2    C3    C4    C5    C6
## E1   0.00  0.01  0.00  0.01  0.00  0.02  0.00 -0.01  0.00  0.00  0.00 -0.01
## E2   0.01 -0.01 -0.02 -0.01  0.00  0.00 -0.01  0.00  0.00 -0.01  0.00 -0.01
## E3   0.02  0.00  0.00 -0.01 -0.01  0.01  0.01  0.00  0.00 -0.02 -0.01  0.00
## E4   0.00  0.00  0.01  0.00  0.00  0.01 -0.01  0.00 -0.01  0.01  0.01 -0.02
## E5   0.00  0.00  0.02  0.01  0.00  0.03 -0.01  0.00  0.01  0.00  0.01  0.00
## E6   0.00  0.01 -0.01 -0.01 -0.01 -0.01  0.00 -0.01 -0.01  0.00  0.02  0.01
## E7   0.02  0.00 -0.01  0.01 -0.01  0.01 -0.02 -0.01  0.00  0.01  0.01 -0.01
## E8   0.02  0.00  0.03  0.04 -0.01  0.03 -0.02 -0.02  0.00 -0.01 -0.01  0.00
## E9  -0.01 -0.01 -0.01 -0.02  0.02 -0.02  0.00  0.00  0.00  0.01  0.00  0.00
## E10  0.00  0.01 -0.01  0.00  0.00  0.01  0.00 -0.01  0.00 -0.01  0.00  0.00
## N1   0.02  0.01  0.00  0.00 -0.01  0.01  0.02  0.01 -0.01  0.00  0.00  0.00
## N2   0.00  0.02  0.01  0.00 -0.01 -0.01  0.01  0.00  0.01 -0.01 -0.02 -0.01
## N3   0.01  0.01  0.02  0.01  0.00  0.01  0.00  0.00  0.06  0.00 -0.01  0.01
## N4  -0.02  0.00 -0.01 -0.01 -0.01 -0.01  0.00 -0.01 -0.01  0.01  0.03  0.01
## N5   0.00  0.01 -0.02 -0.02 -0.01  0.00 -0.02 -0.03 -0.03 -0.01  0.01 -0.01
## N6  -0.01  0.03 -0.02  0.00 -0.01  0.00  0.00 -0.01 -0.02 -0.01  0.02  0.01
## N7   0.00  0.00  0.00  0.00  0.00  0.00  0.00  0.01  0.00 -0.01 -0.01  0.01
## N8   0.00  0.00  0.00  0.00  0.00  0.00  0.01  0.00  0.00  0.00  0.00  0.00
## N9  -0.01 -0.02 -0.01 -0.01  0.01 -0.01 -0.01 -0.01 -0.01 -0.02 -0.02 -0.02
## N10  0.00 -0.01  0.01  0.00  0.01  0.02 -0.01 -0.01  0.01  0.03  0.01 -0.02
## A1   0.00 -0.01  0.00 -0.02  0.02  0.01  0.00 -0.02  0.03  0.01  0.03  0.00
## A2   0.02  0.00 -0.03 -0.01  0.01  0.00  0.00 -0.01 -0.01 -0.01  0.00 -0.02
## A3  -0.02 -0.05  0.01  0.02  0.03 -0.05  0.00 -0.01  0.01  0.03 -0.01 -0.03
## A4  -0.01 -0.01  0.01 -0.01  0.02 -0.02  0.01  0.00  0.00  0.01 -0.01 -0.01
## A5   0.00  0.01  0.03 -0.02  0.00  0.02 -0.01  0.01  0.01 -0.01 -0.01  0.00
## A6   0.01  0.00 -0.01  0.01 -0.01  0.01 -0.01  0.00 -0.02 -0.02  0.01  0.01
## A7   0.03 -0.01  0.00  0.02  0.00  0.01  0.01  0.02  0.01  0.01 -0.01  0.01
## A8  -0.02  0.01  0.02  0.00  0.00  0.03  0.00 -0.01  0.01  0.01  0.00  0.00
## A9   0.00 -0.01  0.00  0.00  0.00  0.00  0.00  0.00  0.02  0.00  0.00  0.00
## A10  0.02  0.01  0.01  0.03  0.00  0.00 -0.04  0.00  0.00 -0.02 -0.01  0.00
## C1  -0.01 -0.01  0.01  0.00  0.00 -0.04  0.00  0.03  0.02  0.00  0.01  0.03
## C2   0.01  0.00  0.02 -0.01  0.00  0.00  0.03  0.00  0.00  0.01  0.00  0.08
## C3   0.01 -0.02  0.01  0.01  0.02  0.00  0.02  0.00  0.00  0.01 -0.04 -0.01
## C4  -0.01 -0.02  0.01  0.01  0.00 -0.02  0.00  0.01  0.01  0.00  0.03  0.01
## C5  -0.01  0.01 -0.01  0.00  0.00 -0.01  0.01  0.00 -0.04  0.03  0.00  0.01
## C6   0.00  0.01  0.01  0.00  0.00  0.00  0.03  0.08 -0.01  0.01  0.01  0.00
## C7   0.01  0.00  0.01  0.00 -0.01 -0.01 -0.02  0.00  0.01  0.00 -0.02 -0.01
## C8   0.00 -0.01  0.00 -0.01  0.01 -0.01 -0.01 -0.05  0.03  0.02 -0.05 -0.03
## C9  -0.01 -0.01  0.01 -0.01  0.02 -0.03  0.05  0.04 -0.03  0.02  0.03  0.03
## C10  0.00  0.00  0.01 -0.01  0.00  0.04  0.00  0.04  0.08  0.01  0.00  0.03
## O1   0.00  0.01 -0.01 -0.01 -0.01  0.00  0.01  0.00 -0.02 -0.01  0.00  0.00
## O2  -0.02  0.00 -0.02  0.00 -0.01  0.00 -0.01 -0.01 -0.02 -0.01  0.00 -0.01
## O3  -0.01  0.00  0.01  0.00  0.00  0.00  0.01  0.01  0.00  0.00  0.00  0.01
## O4  -0.01 -0.01 -0.02  0.00  0.00  0.00  0.00 -0.02 -0.02 -0.01 -0.02 -0.02
## O5   0.00  0.01 -0.02 -0.01 -0.01  0.00  0.00 -0.02 -0.02 -0.02 -0.01 -0.02
## O6   0.00  0.00  0.01  0.00  0.00  0.00 -0.01 -0.01  0.01  0.01  0.01 -0.01
## O7   0.01 -0.01  0.01  0.00  0.01  0.02  0.01  0.02  0.04 -0.01  0.00  0.01
## O8  -0.01  0.01 -0.01  0.01  0.00 -0.01 -0.01 -0.01 -0.01  0.00  0.01 -0.01
## O9   0.02  0.00  0.02  0.01  0.00  0.02 -0.02  0.01  0.01  0.00 -0.02 -0.01
## O10  0.00  0.00  0.00  0.01  0.00 -0.01 -0.01 -0.02 -0.02  0.01  0.01 -0.01
##        C7    C8    C9   C10    O1    O2    O3    O4    O5    O6    O7    O8
## E1  -0.01  0.01 -0.01  0.00  0.00 -0.01  0.00 -0.02  0.01  0.01  0.00  0.00
## E2  -0.02  0.00 -0.01 -0.01  0.00 -0.02 -0.02 -0.03  0.01  0.01  0.00  0.00
## E3  -0.01  0.00 -0.01 -0.01  0.01 -0.03  0.00 -0.01  0.00  0.00  0.02 -0.01
## E4  -0.01  0.01 -0.01  0.00  0.00 -0.01  0.00  0.00  0.01  0.01  0.00  0.00
## E5  -0.01  0.00  0.00  0.00  0.00 -0.01  0.00 -0.01  0.00  0.01  0.00 -0.01
## E6  -0.02  0.00  0.00 -0.01 -0.01 -0.03  0.00 -0.03  0.01  0.01  0.00  0.00
## E7   0.00  0.00 -0.01  0.00 -0.01 -0.03 -0.02 -0.03  0.00  0.01  0.01  0.00
## E8   0.01  0.01 -0.03 -0.02  0.00 -0.01  0.00  0.00  0.00  0.00  0.03 -0.01
## E9   0.02  0.02  0.02  0.02 -0.01 -0.01  0.00 -0.02  0.00  0.01  0.01  0.00
## E10  0.00  0.01  0.01  0.01  0.00  0.00  0.00  0.00 -0.01 -0.01 -0.01  0.00
## N1  -0.01  0.00 -0.01 -0.01  0.01 -0.01 -0.01 -0.01  0.01  0.00  0.00  0.00
## N2   0.02  0.02 -0.01 -0.02  0.00  0.00  0.00 -0.02  0.00 -0.01  0.00  0.00
## N3   0.00  0.02 -0.01  0.00 -0.02 -0.02  0.00 -0.02 -0.01  0.01  0.02 -0.01
## N4   0.00  0.00  0.01 -0.01  0.00  0.00  0.01  0.00 -0.01  0.00  0.00  0.01
## N5   0.01  0.00 -0.02 -0.01  0.01  0.01  0.00 -0.01  0.02  0.00  0.00  0.01
## N6  -0.02 -0.01 -0.01 -0.01  0.01 -0.01  0.00 -0.01  0.00 -0.01  0.01  0.00
## N7   0.01 -0.01  0.00  0.00 -0.01  0.00  0.00  0.00  0.00  0.00  0.00  0.00
## N8   0.00  0.00  0.00  0.00  0.00  0.01  0.00  0.01  0.00  0.00 -0.01  0.00
## N9   0.00 -0.01  0.00  0.00  0.00 -0.02  0.00 -0.01 -0.01 -0.01  0.01  0.00
## N10 -0.01  0.01 -0.01  0.01 -0.01  0.00 -0.01 -0.01 -0.01  0.03  0.01 -0.01
## A1  -0.04  0.04 -0.01  0.01  0.00 -0.01 -0.01 -0.03 -0.01  0.00  0.04  0.00
## A2  -0.01  0.01 -0.01 -0.01  0.01  0.01  0.00 -0.01  0.01  0.01 -0.01  0.00
## A3   0.03  0.02  0.01 -0.02 -0.03 -0.01  0.01  0.00  0.00  0.02 -0.01  0.02
## A4   0.02  0.01  0.00  0.00  0.00  0.00  0.00  0.00  0.00  0.00  0.00  0.00
## A5   0.01  0.00 -0.01  0.00  0.00 -0.02 -0.01 -0.01  0.00  0.00  0.01 -0.01
## A6   0.00 -0.01 -0.01  0.00  0.01  0.00  0.00 -0.01  0.01  0.00 -0.01  0.01
## A7   0.01  0.00  0.01  0.01 -0.01 -0.02  0.01 -0.02 -0.02  0.01  0.01 -0.01
## A8   0.00 -0.01 -0.01 -0.01 -0.01  0.00  0.00  0.00 -0.01  0.00  0.00  0.01
## A9  -0.01  0.01  0.02  0.00 -0.01 -0.01  0.00  0.00 -0.01  0.00  0.01  0.00
## A10 -0.01 -0.01 -0.03  0.04  0.00  0.00  0.00  0.00  0.00  0.00  0.02 -0.01
## C1  -0.02 -0.01  0.05  0.00  0.01 -0.01  0.01  0.00  0.00 -0.01  0.01 -0.01
## C2   0.00 -0.05  0.04  0.04  0.00 -0.01  0.01 -0.02 -0.02 -0.01  0.02 -0.01
## C3   0.01  0.03 -0.03  0.08 -0.02 -0.02  0.00 -0.02 -0.02  0.01  0.04 -0.01
## C4   0.00  0.02  0.02  0.01 -0.01 -0.01  0.00 -0.01 -0.02  0.01 -0.01  0.00
## C5  -0.02 -0.05  0.03  0.00  0.00  0.00  0.00 -0.02 -0.01  0.01  0.00  0.01
## C6  -0.01 -0.03  0.03  0.03  0.00 -0.01  0.01 -0.02 -0.02 -0.01  0.01 -0.01
## C7   0.00  0.03  0.05  0.01 -0.01  0.00  0.01 -0.01 -0.01  0.01 -0.01  0.00
## C8   0.03  0.00 -0.01 -0.04 -0.01 -0.01 -0.01  0.00  0.01  0.01  0.01  0.00
## C9   0.05 -0.01  0.00  0.00 -0.01 -0.01  0.00 -0.01 -0.01 -0.01 -0.02  0.00
## C10  0.01 -0.04  0.00  0.00 -0.02 -0.01  0.00 -0.02 -0.03  0.00  0.03  0.00
## O1  -0.01 -0.01 -0.01 -0.02  0.00  0.02  0.00  0.03  0.02 -0.01  0.00  0.01
## O2   0.00 -0.01 -0.01 -0.01  0.02  0.00  0.01  0.20  0.03 -0.01 -0.09  0.02
## O3   0.01 -0.01  0.00  0.00  0.00  0.01  0.00  0.01 -0.01 -0.01  0.01  0.00
## O4  -0.01  0.00 -0.01 -0.02  0.03  0.20  0.01  0.00  0.04 -0.01  0.00  0.01
## O5  -0.01  0.01 -0.01 -0.03  0.02  0.03 -0.01  0.04  0.00  0.00 -0.01  0.01
## O6   0.01  0.01 -0.01  0.00 -0.01 -0.01 -0.01 -0.01  0.00  0.00  0.00  0.00
## O7  -0.01  0.01 -0.02  0.03  0.00 -0.09  0.01  0.00 -0.01  0.00  0.00 -0.02
## O8   0.00  0.00  0.00  0.00  0.01  0.02  0.00  0.01  0.01  0.00 -0.02  0.00
## O9   0.04  0.00  0.01  0.01 -0.01 -0.03  0.01 -0.06 -0.02  0.03 -0.01 -0.01
## O10  0.00  0.01  0.00 -0.02  0.00  0.03  0.00  0.02  0.04  0.00 -0.03  0.01
##        O9   O10
## E1  -0.01  0.00
## E2   0.01  0.01
## E3  -0.01 -0.01
## E4   0.00  0.00
## E5   0.02  0.01
## E6  -0.01  0.00
## E7   0.02  0.01
## E8   0.00  0.01
## E9   0.02 -0.01
## E10  0.01 -0.01
## N1  -0.01  0.00
## N2   0.02 -0.01
## N3   0.02 -0.01
## N4   0.01  0.00
## N5   0.00 -0.01
## N6  -0.01 -0.01
## N7   0.00  0.00
## N8   0.00  0.00
## N9   0.01 -0.01
## N10  0.04  0.02
## A1  -0.01 -0.01
## A2   0.01  0.00
## A3   0.00  0.00
## A4   0.00  0.00
## A5   0.02  0.00
## A6   0.00  0.00
## A7   0.02  0.00
## A8   0.01  0.01
## A9   0.00  0.00
## A10  0.02 -0.01
## C1  -0.02 -0.01
## C2   0.01 -0.02
## C3   0.01 -0.02
## C4   0.00  0.01
## C5  -0.02  0.01
## C6  -0.01 -0.01
## C7   0.04  0.00
## C8   0.00  0.01
## C9   0.01  0.00
## C10  0.01 -0.02
## O1  -0.01  0.00
## O2  -0.03  0.03
## O3   0.01  0.00
## O4  -0.06  0.02
## O5  -0.02  0.04
## O6   0.03  0.00
## O7  -0.01 -0.03
## O8  -0.01  0.01
## O9   0.00  0.00
## O10  0.00  0.00

Very good - after extracting 10 factors, there is just a bit of crumbs!

OK - so we have done a quick & dirty factor analysis - just to get the general principles in place. We now expand with more detail.

Example 2: Choosing the Number of Factors, etc…

For the second example, we use a smaller data set.

Prelim - Reading in Multiobservation Multivariate Data

This is simulated data - modeled after a private data set. There are 2 samples in the data - designated by id.

#Reading the data from web location
#set filepath for data file
filepath <- "https://raw.githubusercontent.com/The-Change-Lab/collaborations/refs/heads/main/GrowthModeling/ptechdata.csv"
#read in the .csv file using the url() function
pdat <- read.csv(file=filepath, header=TRUE)

Lets split the data and remove the id variable

#splitting data
pdat1 <- pdat[pdat$id==1,-1] 
pdat2 <- pdat[pdat$id==2,-1]

Lets have a quick look at the first sample and the descriptives.

#data structure
head(pdat1, 10)
##       v1    v2    v3    v4    v5    v6    v7    v8    v9
## 1  -0.84 -0.27 -0.59 -0.97 -0.72 -1.86  1.11  0.46  0.09
## 2  -0.04 -0.33 -0.54  2.57  1.30  0.59  1.42  2.56  0.66
## 3   0.34 -0.23  0.99 -1.84 -1.62 -1.55  1.05  0.22  0.60
## 4  -1.01 -1.96 -1.17 -2.93 -1.75 -1.89 -0.51 -0.07  1.14
## 5   2.02  0.21  0.97  0.13 -0.01 -0.88 -1.22  0.54 -0.28
## 6  -0.24 -0.19  0.23  0.80  1.06  1.61  1.31 -1.10  0.26
## 7  -0.61 -1.37  0.15 -0.68 -1.50 -0.44 -1.63  1.40  1.79
## 8  -1.26 -2.59 -1.10 -0.40 -0.66  0.29 -1.45 -1.06  0.15
## 9   0.23  0.25 -0.21  0.23 -0.42  1.01  0.15  1.16 -0.36
## 10  1.01 -0.08  1.95  1.14 -0.06 -0.48 -0.62 -1.27 -0.08
#descriptives
describe(pdat1)
##    vars   n  mean   sd median trimmed  mad   min  max range  skew kurtosis   se
## v1    1 100  0.00 0.95   0.03    0.00 0.96 -2.33 2.44  4.77  0.04    -0.41 0.10
## v2    2 100 -0.14 0.97  -0.11   -0.12 0.90 -2.59 2.07  4.66 -0.21    -0.21 0.10
## v3    3 100  0.04 0.91   0.09    0.08 0.90 -3.11 2.10  5.21 -0.46     0.72 0.09
## v4    4 100 -0.13 0.93  -0.06   -0.11 0.93 -2.93 2.57  5.50 -0.15     0.21 0.09
## v5    5 100 -0.18 0.85  -0.29   -0.20 0.83 -2.04 1.75  3.79  0.25    -0.31 0.09
## v6    6 100 -0.01 0.98   0.06    0.01 0.81 -2.37 2.24  4.61 -0.21    -0.34 0.10
## v7    7 100  0.12 0.94   0.12    0.12 1.02 -1.91 2.14  4.05  0.04    -0.68 0.09
## v8    8 100 -0.03 1.04   0.00   -0.03 0.93 -2.58 2.56  5.14 -0.05    -0.32 0.10
## v9    9 100  0.17 0.96   0.26    0.18 0.93 -2.54 2.47  5.01 -0.20    -0.17 0.10

Data appear to already be in standardized form.

Lets look at the raw data.

pairs.panels(pdat1)

The research question is - Can these data be represented by a smaller number of factors?

Store and examine the correlation matrices

#correlation matrix
round(cor(pdat1), 2)
##       v1    v2    v3   v4   v5    v6    v7    v8    v9
## v1  1.00  0.66  0.71 0.14 0.21  0.05 -0.02  0.07  0.03
## v2  0.66  1.00  0.61 0.13 0.16  0.16  0.03 -0.03  0.02
## v3  0.71  0.61  1.00 0.14 0.13  0.11 -0.12  0.00 -0.03
## v4  0.14  0.13  0.14 1.00 0.49  0.52  0.18  0.14  0.10
## v5  0.21  0.16  0.13 0.49 1.00  0.38  0.24  0.09  0.16
## v6  0.05  0.16  0.11 0.52 0.38  1.00  0.04  0.15 -0.03
## v7 -0.02  0.03 -0.12 0.18 0.24  0.04  1.00  0.40  0.29
## v8  0.07 -0.03  0.00 0.14 0.09  0.15  0.40  1.00  0.26
## v9  0.03  0.02 -0.03 0.10 0.16 -0.03  0.29  0.26  1.00
corrplot(cor(pdat1), order = "original", tl.col='black', tl.cex=.75) 

We see three “groups” of variables that are positively correlated. This gives us hope.

Traditionally, EFA was an analysis of a correlation matrix. Most programs now can also read the raw data directly. We make the correlation matrix to be explicit (and so that we know how that matrix was made - e.g, how the missing data were treated).

Store the correlation matrix of the data into an object

corpdat1 <- cor(pdat1, use="pairwise.complete.obs")
corpdat1
##             v1          v2           v3        v4         v5          v6
## v1  1.00000000  0.65976178  0.707293038 0.1384304 0.21243923  0.04765664
## v2  0.65976178  1.00000000  0.611290349 0.1317872 0.16188108  0.16125106
## v3  0.70729304  0.61129035  1.000000000 0.1373615 0.12634369  0.10552785
## v4  0.13843038  0.13178718  0.137361546 1.0000000 0.48822168  0.51674523
## v5  0.21243923  0.16188108  0.126343694 0.4882217 1.00000000  0.37730021
## v6  0.04765664  0.16125106  0.105527848 0.5167452 0.37730021  1.00000000
## v7 -0.02354195  0.02976057 -0.116982880 0.1808370 0.24081229  0.03741838
## v8  0.06859518 -0.03458348  0.002804632 0.1398046 0.08966386  0.15383876
## v9  0.02845927  0.02415579 -0.029471278 0.1026108 0.15878760 -0.02887585
##             v7           v8          v9
## v1 -0.02354195  0.068595180  0.02845927
## v2  0.02976057 -0.034583485  0.02415579
## v3 -0.11698288  0.002804632 -0.02947128
## v4  0.18083704  0.139804599  0.10261085
## v5  0.24081229  0.089663855  0.15878760
## v6  0.03741838  0.153838758 -0.02887585
## v7  1.00000000  0.401410299  0.29346736
## v8  0.40141030  1.000000000  0.25623468
## v9  0.29346736  0.256234679  1.00000000

Choosing number of factors

We can inform our choice of number of factors with a number of functions. We can use fa.parallel() in the psych package, or the nScree() function in the nFactors package.

#parallel analysis for number of factors 
psych::fa.parallel(x=corpdat1, fm="minres", fa="fa")
## Warning in psych::fa.parallel(x = corpdat1, fm = "minres", fa = "fa"): It seems
## as if you are using a correlation matrix, but have not specified the number of
## cases. The number of subjects is arbitrarily set to be 100

## Parallel analysis suggests that the number of factors =  3  and the number of components =  NA
#multiple methods for number of factors
nFactors::nScree(x=corpdat1, model="factors")
##   noc naf nparallel nkaiser
## 1   3   3         3       3
plot(nFactors::nScree(x=corpdat1, model="factors"))

The output here is number of components/factors according to optimal coordinates (noc), acceleration factor (naf), parallel analysis (nparallel), and Kaiser rule (nkaiser).

For these data - everything points to choice of 3 factors.

Factor analysis with Oblique rotation

Now lets run the factor analysis. This time we use the fa() in the psych package, with oblique oblimin rotation (rotate=“oblimin”) and principal factor extraction (fm=“pa”).

EFApdat1_3factor <- fa(r = corpdat1, nfactors = 3, 
                       rotate = "oblimin", 
                       fm = "pa")
EFApdat1_3factor
## Factor Analysis using method =  pa
## Call: fa(r = corpdat1, nfactors = 3, rotate = "oblimin", fm = "pa")
## Standardized loadings (pattern matrix) based upon correlation matrix
##      PA1   PA2   PA3   h2   u2 com
## v1  0.90 -0.04  0.06 0.79 0.21 1.0
## v2  0.74  0.05  0.00 0.56 0.44 1.0
## v3  0.80  0.02 -0.10 0.66 0.34 1.0
## v4  0.00  0.78  0.04 0.62 0.38 1.0
## v5  0.09  0.54  0.15 0.38 0.62 1.2
## v6 -0.03  0.70 -0.10 0.46 0.54 1.0
## v7 -0.03  0.01  0.73 0.54 0.46 1.0
## v8  0.02  0.04  0.51 0.27 0.73 1.0
## v9  0.03 -0.03  0.45 0.20 0.80 1.0
## 
##                        PA1  PA2  PA3
## SS loadings           2.01 1.41 1.07
## Proportion Var        0.22 0.16 0.12
## Cumulative Var        0.22 0.38 0.50
## Proportion Explained  0.45 0.31 0.24
## Cumulative Proportion 0.45 0.76 1.00
## 
##  With factor correlations of 
##       PA1  PA2   PA3
## PA1  1.00 0.21 -0.02
## PA2  0.21 1.00  0.26
## PA3 -0.02 0.26  1.00
## 
## Mean item complexity =  1
## Test of the hypothesis that 3 factors are sufficient.
## 
## df null model =  36  with the objective function =  2.55
## df of  the model are 12  and the objective function was  0.15 
## 
## The root mean square of the residuals (RMSR) is  0.03 
## The df corrected root mean square of the residuals is  0.06 
## 
## Fit based upon off diagonal values = 0.99
## Measures of factor score adequacy             
##                                                    PA1  PA2  PA3
## Correlation of (regression) scores with factors   0.94 0.87 0.81
## Multiple R square of scores with factors          0.88 0.76 0.66
## Minimum correlation of possible factor scores     0.75 0.51 0.32
plot(EFApdat1_3factor)

The solution looks pretty good.

Our objective here was data reduction. To make that explicit, we can obtain the factor scores by inputting the raw data matrix instead of the correlation matrix. Additionally, we can specify the ‘scores’ argument as below to get factor scores by a factor score regression method. To get estimated factor scores we must input the raw data.

EFApdat1_3factor <- fa(r = pdat1, nfactors = 3, 
                       rotate = "oblimin", 
                       fm = "pa",
                       scores="regression")
head(EFApdat1_3factor$scores, 10)
##             PA1        PA2        PA3
## 1  -0.783420678 -1.1506737  0.5983783
## 2  -0.262502699  2.1004885  1.8211517
## 3   0.433115912 -1.7226209  0.3998862
## 4  -1.419724776 -2.6307726 -0.3797518
## 5   1.476386714 -0.1114002 -0.6023405
## 6   0.007833174  1.3577895  0.5681540
## 7  -0.614527322 -0.8404476 -0.5418789
## 8  -1.578440465 -0.3701222 -1.1402610
## 9   0.122523810  0.5020814  0.1907809
## 10  1.232518910  0.5499773 -0.7593508

NOTE: We do have factor score indeterminacy! So, be careful.

Lets look at the “reduced” data.

pairs.panels(EFApdat1_3factor$scores)

But do not forget that there are also unique factors too. The factors only capture common variance. There may be quite a bit of stuff left over.

Remember that the variance accounted for by the 3 factors is only part of the total variance. Specifically, 0.499181, which we see in the main output

EFApdat1_3factor$Vaccounted[3, 3]
## [1] 0.499181

All the other parts are in the uniquenesses and misfit.

#Uniquenesses
round(EFApdat1_3factor$uniquenesses,3)
##    v1    v2    v3    v4    v5    v6    v7    v8    v9 
## 0.209 0.441 0.336 0.379 0.617 0.541 0.458 0.726 0.801
#residuals (diagonal removed)
round(EFApdat1_3factor$residual - EFApdat1_3factor$uniquenesses,3)
##        v1     v2     v3     v4     v5     v6     v7     v8     v9
## v1  0.000 -0.210 -0.214 -0.200 -0.174 -0.246 -0.235 -0.182 -0.220
## v2 -0.443  0.000 -0.434 -0.467 -0.458 -0.399 -0.393 -0.498 -0.435
## v3 -0.341 -0.328  0.000 -0.324 -0.359 -0.334 -0.354 -0.301 -0.338
## v4 -0.371 -0.404 -0.368  0.000 -0.366 -0.386 -0.380 -0.394 -0.365
## v5 -0.581 -0.633 -0.640 -0.603  0.000 -0.622 -0.590 -0.701 -0.576
## v6 -0.579 -0.499 -0.539 -0.548 -0.547  0.000 -0.568 -0.455 -0.589
## v7 -0.484 -0.410 -0.476 -0.458 -0.431 -0.484  0.000 -0.440 -0.490
## v8 -0.699 -0.783 -0.690 -0.741 -0.810 -0.639 -0.708  0.000 -0.701
## v9 -0.812 -0.795 -0.803 -0.787 -0.761 -0.848 -0.834 -0.776  0.000

Intersample Comparisons

We can look at the comparison of the factor solutions in a second sample (e.g., cross-validation).

Lets run the factor analysis on our second sample, pdat2. First we should check if the number of factors is the same.

#correlation matrix
round(cor(pdat2),2)
##       v1    v2    v3   v4   v5   v6    v7    v8    v9
## v1  1.00  0.78  0.79 0.21 0.05 0.24 -0.04 -0.13 -0.13
## v2  0.78  1.00  0.69 0.11 0.14 0.26 -0.01 -0.07 -0.15
## v3  0.79  0.69  1.00 0.19 0.01 0.23  0.01 -0.03 -0.11
## v4  0.21  0.11  0.19 1.00 0.49 0.55  0.39  0.29  0.32
## v5  0.05  0.14  0.01 0.49 1.00 0.47  0.30  0.09  0.28
## v6  0.24  0.26  0.23 0.55 0.47 1.00  0.28  0.12  0.31
## v7 -0.04 -0.01  0.01 0.39 0.30 0.28  1.00  0.56  0.52
## v8 -0.13 -0.07 -0.03 0.29 0.09 0.12  0.56  1.00  0.44
## v9 -0.13 -0.15 -0.11 0.32 0.28 0.31  0.52  0.44  1.00
corrplot(cor(pdat2), order = "original", tl.col='black', tl.cex=.75) 

#parallel analysis for number of factors 
psych::fa.parallel(x=pdat2, fm="minres", fa="fa")

## Parallel analysis suggests that the number of factors =  2  and the number of components =  NA
#multiple methods for number of factors
nFactors::nScree(x=pdat2,model="factors")
##   noc naf nparallel nkaiser
## 1   2   2         2       3
plot(nFactors::nScree(x=pdat2,model="factors"))

Hmmm… that is a bit problematic for the intersample comparison. The information points towards 2 factors. What are those eigen values?

eigen(cor(pdat2))$values
## [1] 2.9515136 2.5756903 1.1183328 0.5704920 0.5448644 0.4283432 0.3945002
## [8] 0.2616947 0.1545689

Hmm… Ok lets look at the 2-factor and 3-factor solutions.

#2-factor model
EFApdat2_2factor <- fa(r = pdat1, nfactors = 2, 
                       rotate = "oblimin", 
                       fm = "pa",
                       scores="regression")
EFApdat2_2factor
## Factor Analysis using method =  pa
## Call: fa(r = pdat1, nfactors = 2, rotate = "oblimin", scores = "regression", 
##     fm = "pa")
## Standardized loadings (pattern matrix) based upon correlation matrix
##      PA1   PA2    h2   u2 com
## v1  0.85  0.02 0.724 0.28 1.0
## v2  0.74  0.05 0.564 0.44 1.0
## v3  0.84 -0.05 0.687 0.31 1.0
## v4  0.02  0.70 0.496 0.50 1.0
## v5  0.06  0.63 0.418 0.58 1.0
## v6  0.02  0.52 0.280 0.72 1.0
## v7 -0.18  0.43 0.179 0.82 1.3
## v8 -0.10  0.36 0.122 0.88 1.2
## v9 -0.09  0.28 0.072 0.93 1.2
## 
##                        PA1  PA2
## SS loadings           2.00 1.54
## Proportion Var        0.22 0.17
## Cumulative Var        0.22 0.39
## Proportion Explained  0.57 0.43
## Cumulative Proportion 0.57 1.00
## 
##  With factor correlations of 
##      PA1  PA2
## PA1 1.00 0.24
## PA2 0.24 1.00
## 
## Mean item complexity =  1.1
## Test of the hypothesis that 2 factors are sufficient.
## 
## df null model =  36  with the objective function =  2.55 with Chi Square =  242.79
## df of  the model are 19  and the objective function was  0.48 
## 
## The root mean square of the residuals (RMSR) is  0.09 
## The df corrected root mean square of the residuals is  0.12 
## 
## The harmonic n.obs is  100 with the empirical chi square  53.55  with prob <  3.9e-05 
## The total n.obs was  100  with Likelihood Chi Square =  44.91  with prob <  0.00071 
## 
## Tucker Lewis Index of factoring reliability =  0.759
## RMSEA index =  0.116  and the 90 % confidence intervals are  0.073 0.162
## BIC =  -42.59
## Fit based upon off diagonal values = 0.9
## Measures of factor score adequacy             
##                                                    PA1  PA2
## Correlation of (regression) scores with factors   0.93 0.85
## Multiple R square of scores with factors          0.86 0.72
## Minimum correlation of possible factor scores     0.72 0.44
#3-factor model
EFApdat2_3factor <- fa(r = pdat1, nfactors = 3, 
                       rotate = "oblimin", 
                       fm = "pa",
                       scores="regression")
EFApdat2_3factor
## Factor Analysis using method =  pa
## Call: fa(r = pdat1, nfactors = 3, rotate = "oblimin", scores = "regression", 
##     fm = "pa")
## Standardized loadings (pattern matrix) based upon correlation matrix
##      PA1   PA2   PA3   h2   u2 com
## v1  0.90 -0.04  0.06 0.79 0.21 1.0
## v2  0.74  0.05  0.00 0.56 0.44 1.0
## v3  0.80  0.02 -0.10 0.66 0.34 1.0
## v4  0.00  0.78  0.04 0.62 0.38 1.0
## v5  0.09  0.54  0.15 0.38 0.62 1.2
## v6 -0.03  0.70 -0.10 0.46 0.54 1.0
## v7 -0.03  0.01  0.73 0.54 0.46 1.0
## v8  0.02  0.04  0.51 0.27 0.73 1.0
## v9  0.03 -0.03  0.45 0.20 0.80 1.0
## 
##                        PA1  PA2  PA3
## SS loadings           2.01 1.41 1.07
## Proportion Var        0.22 0.16 0.12
## Cumulative Var        0.22 0.38 0.50
## Proportion Explained  0.45 0.31 0.24
## Cumulative Proportion 0.45 0.76 1.00
## 
##  With factor correlations of 
##       PA1  PA2   PA3
## PA1  1.00 0.21 -0.02
## PA2  0.21 1.00  0.26
## PA3 -0.02 0.26  1.00
## 
## Mean item complexity =  1
## Test of the hypothesis that 3 factors are sufficient.
## 
## df null model =  36  with the objective function =  2.55 with Chi Square =  242.79
## df of  the model are 12  and the objective function was  0.15 
## 
## The root mean square of the residuals (RMSR) is  0.03 
## The df corrected root mean square of the residuals is  0.06 
## 
## The harmonic n.obs is  100 with the empirical chi square  7.48  with prob <  0.82 
## The total n.obs was  100  with Likelihood Chi Square =  14.19  with prob <  0.29 
## 
## Tucker Lewis Index of factoring reliability =  0.967
## RMSEA index =  0.042  and the 90 % confidence intervals are  0 0.116
## BIC =  -41.07
## Fit based upon off diagonal values = 0.99
## Measures of factor score adequacy             
##                                                    PA1  PA2  PA3
## Correlation of (regression) scores with factors   0.94 0.87 0.81
## Multiple R square of scores with factors          0.88 0.76 0.66
## Minimum correlation of possible factor scores     0.75 0.51 0.32

Let’s go with the 3 factor solution. It looks a bit better all around.

With the same size p x q factor loading matrix for the two samples (here 9 x 3), we can compare the pattern of loadings between the two samples using the Tucker Index of Factor Congruence.

This is easily obtained by applying the factor.congruence function in the psych package to two factor loading matrices.

psych::fa.congruence(EFApdat1_3factor, EFApdat2_3factor)
##      PA1  PA2  PA3
## PA1 1.00 0.03 0.00
## PA2 0.03 1.00 0.04
## PA3 0.00 0.04 1.00

We see very good alignment across the two samples!

Something Clever!

We’ve done something clever here to make a point.

These two samples are actually two different persons, each of whom completed 100 days of reports (repeated measures). We have actually conducted two person-specific factor analyses. The mechanics of cross-sectional factor analysis (R-technique) and (P-technique) are identical - just the data and interpretation are different.

Our data reduction has allowed us to reduce the complexity of the 9-dimensional data.

#preparing data
day <- 1:100
str(day)
##  int [1:100] 1 2 3 4 5 6 7 8 9 10 ...
pdat1_plot <- cbind(day,pdat1, EFApdat1_3factor$scores)
#Plotting observed scores
pdat1_plot %>%
  ggplot(aes(x=day)) +
  geom_line(aes(y=v1), color= 1) + 
  geom_line(aes(y=v2), color= 2) + 
  geom_line(aes(y=v3), color= 3) + 
  geom_line(aes(y=v4), color= 4) + 
  geom_line(aes(y=v5), color= 5) + 
  geom_line(aes(y=v6), color= 6) + 
  geom_line(aes(y=v7), color= 7) + 
  geom_line(aes(y=v8), color= 8) + 
  geom_line(aes(y=v9), color= 9) +
  xlab("Day") + ylab("Observed Score") + 
  scale_x_continuous(limits=c(0,100)) +
  scale_y_continuous(limits=c(-3,3)) 

to 3-dimensional data - by setting aside 50% of the variance.

#Plotting factor scores
pdat1_plot %>%
  ggplot(aes(x=day)) +
  geom_line(aes(y=PA1), color= 1) + 
  geom_line(aes(y=PA2), color= 2) + 
  geom_line(aes(y=PA3), color= 3) + 
  xlab("Day") + ylab("Factor Score") + 
  scale_x_continuous(limits=c(0,100)) +
  scale_y_continuous(limits=c(-3,3)) +
  theme_bw()

And we kind-of confirmed that the same structure exists in Sample 2.

Conclusion

Factor Analysis is so cooool! -

Thanks for playing!