Validity and Reliability of a Novel AI-Based System in Athletic Performance Assessment: The Case of DeepSport

Aydemir B., Aydogan M. T., Boz E., Kul M., Kırkbir F., Özkara A. B.

SENSORS, cilt.25, sa.17, 2025 (SCI-Expanded) identifier identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 25 Sayı: 17
  • Basım Tarihi: 2025
  • Doi Numarası: 10.3390/s25175580
  • Dergi Adı: SENSORS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, Aerospace Database, Aqualine, Aquatic Science & Fisheries Abstracts (ASFA), Biotechnology Research Abstracts, CAB Abstracts, Communication Abstracts, Compendex, INSPEC, MEDLINE, Metadex, Veterinary Science Database, Directory of Open Access Journals, Civil Engineering Abstracts
  • Karadeniz Teknik Üniversitesi Adresli: Evet

Özet

This study aimed to examine the validity and reliability of the AI-based DeepSport application by comparing its outcomes with those from the reference device, OptoJump. The primary dependent variables measured were jump height and anaerobic power during vertical jump assessments. Twelve elite male basketball players voluntarily participated in the study (age = 21.53 +/- 1.14 years; sports experience = 6.47 +/- 1.01 years). DeepSport uses AI-based image processing from standard cameras, while OptoJump uses optical sensor technology. Both DeepSport and OptoJump systems were utilized to assess participants' Countermovement Jump (CMJ) and Squat Jump (SJ) performances. A G*Power (version 3.1.9.7) analysis determined the required sample size, adopting a 95% confidence level, 90% test power, and an effect size of 0.25. Validity assessments were conducted using Bland-Altman plots and ordinary least products (OLP) regression analysis, while reliability was evaluated through intraclass correlation coefficient (ICC), coefficient of variation (CV), standard error of measurement (SEM), and smallest detectable change (SDC) analyses. DeepSport showed excellent reliability in CMJ and SJ tests with ICC values > 0.90, and CV ranged between 2.12% and 4.95%. Results were consistent with OptoJump, showing no significant differences according to t-test results (p > 0.05). Bland-Altman analyses indicated no systematic bias and random distribution. These findings confirm that both DeepSport and OptoJump devices demonstrate high reliability and consistency, suggesting their validity and reliability for use in athlete performance assessments by coaches and athletes.