Socially desirable responding in experience sampling: Consequences for personality research

Experience sampling often makes use of items that are similar to personality questionnaire items. Arguably, this opens up for item-popularity effects, where some respondents react to the items' level of evaluative phrasing, causing a separate factor. Gauging the risk of item popularity effects in experience sampling is important since the multifactorial aspect of the responses to the items may cause spurious correlations. We investigate this in one original study and two existing datasets. The results reveal that evaluativeness in experience sampling items creates the same type of problems as in self-rating inventories. We conclude that personality researchers need to be aware that the experience sampling method is not vaccinated against socially desirable responding, and that careful phrasing of items promotes purer personality measures. This allows for more optimal testing of theoretical models of personality, as the fit between data and model will not concern variance in socially desirable responding but in the relevant constructs.