Judge the claim
Personality Traits Exist as Measurements Before They Exist as Essences
Trait models can be useful, stable, and predictive without turning a score into the hidden object it is meant to indicate. Psychometrics supplies the caution personality talk usually skips.
One system
personality
The other
psychometrics of constructs
Trait models and construct validity meet where a pattern of questionnaire responses is interpreted as evidence for a latent disposition rather than a self-announcing inner essence.
Personality becomes empirically tractable through measurement while remaining vulnerable to being mistaken for the score that represents it.
Gordon Allport and Henry Odbert begin with a dictionary, which is a rather grand place to look for the soul and a very good place to find adjectives behaving badly.
They worked through the whole of Webster’s New International and extracted nearly eighteen thousand words describing personality or behavior. About a quarter of them were judged to name stable traits rather than temporary states or evaluations.
The lexical hypothesis supplied the premise. If a distinction matters enough in social life, language will probably have made a word for it.
The dictionary was not a personality test. It was raw material with delusions of grandeur.
Raymond Cattell spent a decade reducing those terms with factor analysis, the method that finds variables correlating more with each other than with the rest.
He settled on sixteen primary factors. Early computer access let him run larger analyses, and it did not compel the universe to be five things wide. Cattell’s model was sixteen, and he disputed the reduction.
Then the reduction kept returning anyway.
Fiske, then Tupes and Christal with Air Force officer ratings, then Norman each found five broad clusters. Goldberg named them the Big Five.
Costa and McCrae reached overlapping terrain from questionnaire construction, fixing the familiar vocabulary of openness, conscientiousness, extraversion, agreeableness, and neuroticism.
This is a respectable origin story. Air Force ratings, dictionary analysis, and clinical questionnaire work arrive by separate doors and find five chairs already set out.
The chairs need not therefore be ghosts, organs, or tiny bureaucrats living behind the forehead with clipboards.
A factor is first a pattern in measurements. It is what the correlations make visible.
Which is exactly where the pattern begins to look like a possession.
If several methods recover the same broad dimensions, if the scores endure, and if they predict things that matter, then perhaps the inventory has located natural kinds. An actual quantum of conscientiousness, tucked behind the ribs, waiting for its questionnaire to announce it.
The evidence does not carry that far.
It supports a model of patterned differences. It supports measurement with error, longitudinal regularity, and limited prediction.
That a factor extracted from one instrument names a discrete causal entity inside a person is speculation. It may be true. Factor analysis itself cannot deliver it, because it begins with correlations among answers, ratings, or behaviors, not with a tour of the alleged inner furniture.
Spearman had already supplied the small warning label.
He developed machinery for treating a test score as a noisy signal, then asked what a correlation might be without measurement error.
Classical test theory condenses the point. An observed score is a hypothetical true score plus random error.
The true score is hypothetical. It is not a little engraved nameplate found under the skin.
The distinction is not a technicality.
A scale may be reliable, meaning a substantial portion of its observed-score variance is not random error, and still have a live validity problem.
Cronbach and Meehl’s paper on construct validity exists precisely because an attribute like anxiety has no clean external object to compare with its score.
Their hypothetical anxiety test is exemplary because it refuses a cheap finish.
A respectable correlation with palmar sweating is not enough. Peer ratings of tenseness, responses to electric shock, another anxiety scale, and differences between diagnosed and non-diagnosed groups would make the interpretation stronger.
Each result can also reveal that the test was measuring something else in a cheap anxiety moustache.
The Big Five have more to show than a neat factor structure.
Meta-analytic heritability estimates for the five dimensions cluster somewhere near half. Those are proportions of variation within the studied populations, not percentages of anyone’s personality delivered by genetics like a parcel.
Stability has a similarly disciplined meaning.
Pooling more than three thousand test-retest correlations, rank-order consistency rises from about .3 in childhood to roughly .5 in the college years, .6 around thirty, and near .75 in later middle age.
Rank-order stability means remaining in a similar place relative to peers. It coexists perfectly well with mean-level change. Conscientiousness and agreeableness tend to rise with age. Neuroticism tends to fall.
Prediction does not rescue essence either.
Across a large meta-analysis of occupational groups, conscientiousness correlates with job performance at around .22 after correction.
It is real, replicated, and modest. A trait score is one input into a working life, not a fortune cookie in a necktie.
Popular type systems make the temptation especially theatrical.
Jung’s Psychological Types supplied the vocabulary. The Myers-Briggs indicator turned it into an instrument with four dichotomies and sixteen boxes.
When Costa and McCrae mapped those dichotomies onto continuous five-factor dimensions, they found no support for the discontinuous, bimodal type structure the categories imply.
The continuum has not, alas, provided the dramatic satisfaction of being told that half the office is one species and the other half its natural enemy.
Even a serious trait scale has another border to cross. Groups.
Measurement invariance asks whether an instrument measures the same construct, in the same way, across specified groups.
Multi-group confirmatory factor analysis tests nested levels. Configural invariance for the same factor structure. Metric invariance for equal loadings. Scalar invariance for equal intercepts. Strict invariance for equal residual variances.
Scalar invariance is the necessary level before means can honestly be compared.
Kato’s depression-scale study gives the requirement a paper trail.
Across White American, White Australian, Indian, Filipino, and Singaporean samples, the twenty-item instrument achieved configural and metric invariance.
Full scalar invariance failed. Only after nine items were released from equality constraints did partial scalar invariance appear.
Identical factor shapes, then, do not guarantee that the same number says the same thing.
That is the whole lesson in one procedure. A construct is a claim about what a pattern of answers is, and the claim has to be argued, not asserted by a coefficient.
What survives is not that personality has finally found the hidden furniture of the self, nor that psychometrics has exposed personality as a crossword puzzle with a confidence interval.
It is that personality becomes empirical by being measured, and becomes philosophically treacherous when the measurement is mistaken for the thing.
The score gives a pattern a handle. It does not make the handle a creature.
The tempting reading, refused
A reliable personality inventory has discovered a natural kind.
Reliability, factor structure, and prediction do not settle reification or measurement invariance.
What you can take forward
- The Big Five emerged through converging lexical, personnel-rating, and questionnaire research rather than from a single inventor.
- Factor analysis identifies clusters of correlated trait descriptions; it does not by itself prove that each factor is a discrete causal entity.
- The Myers-Briggs Type Indicator inherits Jungian categories, while Costa and McCrae's 1989 mapping found no support for the discontinuous bimodal type structure implied by those categories.
- Classical test theory treats an observed score as true score plus random error, and construct validity requires a nomological network rather than a single reassuring correlation.
- Rank-order stability concerns relative standing among peers and can coexist with mean-level personality change across the lifespan.
- Conscientiousness predicts job performance modestly at the population level, not with certainty for any one person.
- Measurement invariance must be tested before comparing group means, because scalar invariance is required for meaningful mean comparisons.
- The CES-D case shows that matching factor structure and loadings across groups does not guarantee that raw mean scores are comparable.
Go deeper
- Where does the Big Five actually come from?
- The Big Five emerges from several independent programs that repeatedly find roughly the same broad dimensions. Allport and Odbert's 1936 dictionary study supplies trait words; Tupes and Christal's 1961 Air Force ratings and Norman's 1963 work recover five broad factors; Costa and McCrae's NEO inventories reach an overlapping structure through questionnaire research. The convergence supports a useful taxonomy, not a single moment of discovery.
- What does factor analysis do in personality research?
- Factor analysis examines which questionnaire items or trait descriptions correlate with one another more than with other items. It reduces a large field of observed correlations into a smaller set of dimensions. In personality research, that procedure helps recover broad trait patterns such as the Big Five. It does not, by itself, establish that a factor is a separate object, organ, or causal entity inside a person.
- Is Myers-Briggs the same kind of model as the Big Five?
- No. The Myers-Briggs Type Indicator descends from Carl Jung's 1921 Psychological Types and sorts people through categorical dichotomies. The Big Five describes continuous dimensions recovered through factor-analytic research. Costa and McCrae's 1989 mapping of MBTI dichotomies onto Five-Factor Model dimensions finds no support for the discontinuous, bimodal type structure implied by Jungian categories. A type label and a trait score therefore make different claims.
- What does it mean when a personality score is reliable?
- Reliability means that an observed score contains a dependable component rather than only random measurement error. Classical test theory expresses the relation as X = T + E: observed score equals hypothetical true score plus random error. Reliability is the proportion of observed-score variance attributed to the true-score component. A reliable score can still measure the wrong attribute, so reliability alone does not establish validity.
- Why is one good correlation not enough to validate a trait?
- A single correlation can be consistent with several interpretations of what a scale measures. Cronbach and Meehl's 1955 account of construct validity therefore requires a nomological network: theoretical propositions connect a construct to other constructs and to observable indicators through correspondence rules. Their hypothetical anxiety test needs converging evidence from multiple sources, not merely one correlation with palmar sweating. Validation remains an accumulating argument.
- Does stable personality mean that people never change?
- No. Rank-order stability measures whether a person's relative standing on a trait remains similar compared with peers at two times. Roberts and DelVecchio's 2000 meta-analysis pools 152 longitudinal studies and 3,217 test-retest correlations, finding stability rises from .31 in childhood to .54 during college years, .64 around age 30, and near .74 between ages 50 and 70. Population averages can still change over the same period.
- Can a personality trait really predict job performance?
- Yes, but modestly and at the population level. Barrick and Mount's 1991 meta-analysis covers 117 studies and finds a mean true-score correlation of rho = .22 between Conscientiousness and job performance, across five occupational groups. The association makes Conscientiousness one relevant input among many; it does not turn a personality score into a certain forecast for a particular applicant or employee.
- What has to happen before a new personality scale is trusted?
- A rigorous scale-development sequence begins with a written construct definition, then generates an item pool, conducts expert content review, pilots the items, analyzes items, tests factor structure, and examines reliability and validity. An item-total correlation below roughly 0.30 is conventionally flagged as weak or off-target. A single high reliability coefficient cannot replace the earlier steps because each catches a different failure mode.
- What is measurement invariance, and why does it matter?
- Measurement invariance means that a scale measures the same construct in the same way across specified groups. Multi-group confirmatory factor analysis tests increasingly restrictive levels: configural, metric, scalar, and strict invariance. Scalar invariance, which requires equal item intercepts as well as equal loadings, is required before group mean scores can be meaningfully compared. Without it, a score difference may partly reflect item behavior rather than trait difference.
- How can two groups have the same factor structure but scores that cannot be compared?
- The 2021 Kato study tests the 20-item CES-D across White Americans, White Australians, Indians, Filipinos, and Singaporeans. Configural and metric invariance hold, so the four-factor structure and factor loadings match acceptably. Full scalar invariance initially fails; releasing equality constraints on nine items yields partial scalar invariance. Matching structure therefore does not guarantee that equal numerical scores carry equal meanings across groups.
- Does a failed invariance test prove groups do not differ in personality?
- No. Failed scalar invariance means that a scale's mean-score comparison is not cleanly interpretable across the tested groups. It does not prove that the groups have identical average levels of the construct, nor that they differ. Some observed difference can reflect genuine trait differences and some can reflect non-invariant items. The test identifies an ambiguity in measurement rather than settling the substantive comparison.
- Why are personality findings discussed alongside the replication crisis?
- Personality findings require the same caution as other psychological results because sampling, analytic flexibility, and publication selection affect what evidence can support. Henrich, Heine, and Norenzayan's 2010 WEIRD paper addresses sampling; Simmons, Nelson, and Simonsohn's 2011 paper addresses analytic flexibility; the Open Science Collaboration's 2015 project addresses published findings. Its 36% headline estimate remains disputed, so it is not a universal replication rate.