Developing and Validating the AI-SMEQ: Measuring the Effects of Artificial Intelligence on Social Media Users

Abstract

The increasing integration of artificial intelligence (AI) in social media platforms has transformed user engagement, personalized content delivery, and the spread of misinformation. Despite its growing influence, a lack of standardized instruments remains to measure AI's effects on user behavior. This study introduces and validates the AI-SMEQ (Artificial Intelligence and Social Media Effect Questionnaire), a psychometric tool designed to assess AI’s impact on social media users. Data were collected from 300 participants, and Exploratory Factor Analysis (EFA) and Confirmatory Factor Analysis (CFA) were conducted using SPSS and JASP. The final model consisted of four factors: (1) AI-driven engagement & Personalization, (2) AI Influence on Social Media Habits, (3) AI and Misinformation Exposure, and (4) AI Awareness & Control. The model fit indices demonstrated strong validity (CFI = 0.92, TLI = 0.91, RMSEA = 0.06), and reliability analysis confirmed internal consistency (Cronbach’s Alpha = 0.78- 0.95). The AI-SMEQ offers a valuable tool for future research on the role of AI in digital consumption, misinformation, and user autonomy.