http://orcid.org/0000-0002-7536-9780
Figures
Abstract
The current study aimed to examine the reliability of the conventional and functional ratios derived from peak torques (PTs) and those obtained from the combination of knee flexors torque at the angle of knee extensors PT. Twenty-six male athletes (mean of 24.0±0.7 years) from different sports completed a test-to-test variation in isokinetic strength (Biodex, System 3) within a period of one week. Anthropometry and body composition assessed by Dual Energy X-ray Absorptiometry were also measured. The proposed isokinetic strength ratio measurements appeared to be highly reliable: conventional ratio at PT angle (intra-class correlation, ICC = 0.98; 95% confidence interval; 95%CI: 0.95 to 0.99); functional extension ratio at PT angle (ICC = 0.98; 95%CI: 0.96 to 0.99); and, functional flexion ratio at PT angle (ICC = 0.95; 95%CI: 0.89 to 0.98). Technical error of measurement (TEM) and associated percentage of the coefficient of variation (%CV) were as follows: conventional ratio at PT angle (TEM = 0.02; %CV = 4.1); functional extension ratio at PT angle (TEM = 0.02; %CV = 3.8); and, functional flexion ratio at PT angle (TEM = 0.03; %CV = 3.6). The current study demonstrated that the traditional and new obtained simple and combined isokinetic indicators seem highly reliable to assess muscle strength and function in adult male athletes. A single testing session seems to be sufficiently to obtain these isokinetic strength indicators.
Citation: Duarte JP, Valente-dos-Santos J, Coelho-e-Silva MJ, Couto P, Costa D, Martinho D, et al. (2018) Reproducibility of isokinetic strength assessment of knee muscle actions in adult athletes: Torques and antagonist-agonist ratios derived at the same angle position. PLoS ONE 13(8): e0202261. https://doi.org/10.1371/journal.pone.0202261
Editor: Laszlo Csernoch, University of Debrecen, HUNGARY
Received: March 6, 2018; Accepted: July 31, 2018; Published: August 15, 2018
Copyright: © 2018 Duarte et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All data are fully available without restriction. All relevant data are within the paper and its Supporting Information files.
Funding: João P. Duarte (SFRH/BD/101083/2014), João Valente-dos-Santos (SFRH/BPD/100470/2014) and Diogo Martinho (SFRH/BD/121441/2016) were partially supported by the Portuguese Foundation for Science and Technology. CIDAF is registered in the Portuguese Foundation for Science and Technology: uid/dtp/04213/2016. There are no other current funding sources for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
The terms muscle strength and muscle power are erroneously used as synonymous in many professional contexts. In the present study, the term ‘muscular strength’ refers to maximal muscular force in a single voluntary contraction [1]. In the meantime, torque corresponds to the ability of a force to cause rotation on a lever. The relationship between the torque exerted by a muscle group and the range of motion of the joint is determined by mechanical characteristics of the anatomical lever system. In many muscle actions, such as knee extension and knee flexion, the mechanical disadvantage of the muscles occurs at the extremes of the range of motion. Isokinetic refers to dynamic muscular contraction characterized by a constant angular velocity of the movement [2, 3]. The angular velocity is kept constant by the dynamometer that adjusts the resistance applied to the muscles through the range of motion (i.e. the load applied to the muscle is increased at the point of highest mechanical advantage of the muscle and, correspondingly, the load is decreased at the extremes of the range of motion).
Several parameters are cited in the literature as a measure of isokinetic strength. Peak torque (PT) is consistently favored as the most prominent information retained for analysis [4, 5] and the angle of its occurrence is often reported [6–8]. Meanwhile, mean torque corresponds to mean values of the moment of force during a particular range of motion. Additionally, and regarding the knee joint, the strength ratios tend to be calculated by dividing the maximal knee flexors (KF) moment by the maximal knee extensors (KE) moment measured at identical angular velocity and concentric (cc) or eccentric (ecc) contraction actions. In other words, the following ratio is usually termed as conventional ratio: KFcc/KEcc [9]. Two other ratios were also suggested to examine the antagonist-agonist strength relationship for knee extension and knee flexion actions. They were termed as functional extension ratio and functional flexion ratio, respectively KFecc/KEcc and KFcc/KEecc [9]. Active quadriceps muscle contraction may create significant anterior tibial translation or shear and it may also produce substantial internal rotation of the tibia relative to the femur [10, 11]. The amount of co-activation of the hamstring muscles was suggested [12] to be crucial for ligamentous constraints, particularly the anterior cruciate ligament.
The conventional and functional ratios are being derived from the respective PTs that occurred at different angles for KE and KF. However, the antagonist-agonist strength relationship should be interpreted at the specific angle, particularly, at the angle of the agonist PT. Because of these data quality properties are of utmost importance in the evaluation of athletes, the purpose of the current study was to examine the reliability of the conventional and functional ratios derived from PTs and those obtained from the combination of KF torque at the angle of KE PT (the denominator in all composite variables).
Materials and methods
Research design and procedures
The present study required repeated measurements with one week apart. The local Ethics Committee (CE/FCDEF-UC/00182016) previously approved the research project. Standards for research in sports medicine were followed taking into account the Declaration of Helsinki. Participants were informed about the objectives of the study, protocols and risks related to data collection. All provided written informed consent, which was approved by the ethics committee before the beginning of the study. Participants were informed that they could withdraw from the experiment at any time. Verbal consent was provided during the second test session to ensure voluntary participation. All measurements were performed at the Laboratory of Biokinetics at the Coimbra University Stadium and participants were instructed to avoid food ingestion for at least three hours before testing and not to drink caffeine during the day. All assessments were performed at the same time of the day (10:00–12:00 a.m.).
Participants
All participants were recruited in the Coimbra University Stadium according to the following inclusion criteria: males, aged >17 years and <36 years; 2+ years of training experience in competitive sports; none had any history of severe time-loss injury in the previous two months; none were taking any medication or supplements known to affect performance. Chronological age was determined to the nearest 0.01 year by subtracting birth date from date of first testing measurement. Training experience was obtained by questionnaire. The sample was composed of 26 adults aged 18.6–33.9 (mean of 24.0±0.7 years) with different training history [soccer (n = 12), combat (n = 4), swimming (n = 3), rowing (n = 2), track and field (n = 1), tennis (n = 1), volleyball (n = 1), cycling (n = 1), and roller hockey (n = 1)]. Sample size was similar to previous studies aimed to examine the reproducibility of isokinetic and isometric knee extensor and flexor muscle strength [13].
Anthropometry
All measurements were obtained by a single experienced observer using standard procedures [14]. Body mass was assessed using a SECA portable scale (model 770, Hanover, MD, USA) with an accuracy of 0.1 kg. Stature was measured using a stadiometer Harpenden (model 98.603, Holtain Ltd, Crosswell, UK) to the nearest 0.1cm. A portable table (Harpenden, model 98.607, Holtain Ltd, Crosswell, UK) was used to measure sitting height to the nearest 0.1 cm. Leg length was estimated as stature minus sitting height.
Body composition
Dual Energy X-ray Absorptiometry was used to assess body composition (Lunar DPX-MD+, Software: enCORE version 4.00.145, GE Lunar Corporation, Madison, WI, USA). All athletes were assessed in the supine position during a visit to a certified laboratory always performed during the mornings. An experienced technician supervised all assessments. The technology provides information regarding bone mineral content, bone mineral density, fat tissue and lean soft tissue. Extracted data for this study included information reporting whole body and lower limbs (dominant lower limb).
Isokinetic dynamometer
The protocol starts with a 5-min warm-up in a cycle ergometer (814E Monark, Varberg, Sweden) using a braking force corresponding to 2% of the body mass [15]. The cadence was kept between 50 and 60 rpm. Afterwards, static stretching was done for the quadriceps, hamstrings and adductors (20 seconds each position). Biodex System 3 dynamometer (Shirley, NY, USA) was used to assess the isokinetic strength of KE and of the KF from the dominant lower limb at an angular velocity of 60°·s-1. This isokinetic dynamometer is a reliable and valid instrument [16]. Participants were seated in the dynamometer according to manufacture guidelines, that is, adopting a standardized position of 85° hip flexion from the anatomical position. The lever arm was aligned with the lateral epicondyle of the knee. The trunk, dominant thigh and leg (slightly above the medial malleolus) were stabilized with belts. Range of motion was defined for 85° degrees (knee flexion 5° to 90°) as follows: athletes were asked to perform a voluntary maximal knee extension and the 0° was settled; afterwards, the initial 5 degrees of the flexion were completed and the dynamometer blocked. The reduction of the initial angles of the flexion was done to allow the athlete to exert at least 10% of the assigned torque limit. Prior to each test, individual calibration was completed for gravity correction [17]. This correction was determined at the position of 30° of knee flexion. During the test, participants were instructed to keep the arms crossed with the hands on the opposite shoulder [18]. A specific 3-repetition trial was performed prior to each isokinetic test [19], to reduce the effect termed “familiarization”. Finally, the test was completed with real-time visual feedback given by the screen of the dynamometer [18]. Reciprocal cc and ecc muscular actions were tested considering 5 repetitions for knee flexion and knee extension at 60°·s-1 (1.05 rad·s-1). A 60-second interval was settled between the 3-repetition familiarization and the test [20]. The sequence was: 3-repetition knee extension cc combined with knee flexion cc; 60-second interval; 5-repetition knee extension cc combined with knee flexion cc; 60-second interval; 3-repetition knee extension ecc combined with knee flexion ecc; 60-second interval; 5-repetition knee extension ecc combined with knee flexion ecc. Data collection was obtained using a sampling rate of 100Hz and it was subsequently analyzed with the software Acqknowledge, version 4.1 (Biopac Systems, Inc., Goleta, CA, USA). Each individual curve was inspected in order to consider true isokinetic torques within 95% confidence interval of the angular velocity of 60°·s-1. The angle of the PT and PT value of the best from five repetitions were retained for analysis (best curve performed by KE and KF in both the cc and ecc actions: KEcc, KEecc, KFcc, KFecc). Composite ratios were derived as follows:
(1)
(2)
(3)
The above-presented ratios were independent of knee-joint angle. Therefore, the measurements of each muscle group were made at different angles. By using an angular velocity of 60°·s-1 and for a range of motion of 85º, the sampling rate of 100 Hz allowed data collection at specific angles. The torque (T) of the KFcc action and the T of the same KFecc action at the angle of the PT of the KEcc action were determined, respectively: T_KFcc at angle PT_KEcc and T_KFecc at angle PT_KEcc. Finally, the T of the KFcc action at the angle of the PT of the KEecc action was also determined (T_KFcc at angle PT_KEecc). T and PT values were expressed in Newton-meter (N·m). The following ratios were also possible:
(4)
(5)
(6)
Statistical analysis
Descriptive statistics (minimum, maximum, mean value, standard error of the mean, 95% confidence interval of the mean, and standard deviation) were calculated for chronological age, training experience and anthropometry. In addition, Kolmogorov-Smirnov test was used to check for normality. Comparisons between type of sports were performed using t-test analysis. Means and standard deviations of PT, torque at specific angles, conventional and functional ratios were presented for each time-moment and intra-individual mean differences were examined using t-test analysis. Effect size was given by d-values of Cohen, which were interpreted as follows: <0.20 (trivial), 0.20 to 0.59 (small), 0.60 to 1.19 (moderate), 1.20 to 1.99 (large), 2.0 to 3.9 (very large), and ≥4.0 (extremely large) [21]. Technical error of measurement (TEM), coefficients of variation (%CV) and intra-class correlation coefficient (ICC) were determined. ICC higher than 0.90 and CV lower than 10% are analytical goals commonly employed in sport and exercise science [22], although recommendations regarding CV in time trial protocols considers a more conservative percentage (<5%) [23]. Additionally, the limits of agreement between ratios were examined by plotting the differences between time-moments relative to mean values of both assessments [24]. Statistical significance was set at p < 0.05 and all analyses were performed using the Statistical Package for the Social Sciences version 23.0 (SPSS Inc., IBM Company, Armonk, NY, USA) and GraphPad Prism software (GraphPad Software, Inc., La Jolla, CA, USA).
Results
Characteristics of the total sample are summarized in Table 1. All variables fit the assumption of normal distribution. Table 2 summarizes descriptive statistics by type of sports [i.e., team sports (soccer, volleyball and roller hockey) and individual sports (combat, swimming, rowing, track and field, tennis and cycling)] and includes results of comparisons between groups. Athletes of contrasting sports did not differ significantly in isokinetic parameters under analysis.
Descriptive statistics for time-moment 1 and time-moment 2 are presented in Table 3, which also included intra-individual differences and results of the paired t-tests for all functional parameters: simple and combined variables. For the PT values, significant intra-individual differences were noted in the cc action of the KF (t = 2.062, p≤0.05). However, the difference was interpreted as trivial. The inspection of torque values at specific angles noted a trivial but significant intra-individual difference for the cc action of the KF at the angle of the PT cc action of the KE (t = 2.027, p≤0.05). With one exception differences are not significant for ratios. The mean values of intra-individual differences were significant for the functional extension ratio at the angle of the PT cc action of the KE (t = 2.586, p≤0.05, trivial).
Table 4 reports the TEM and associated CV, which range between 2.33%-5.19% for PT value and 4.18%-4.46% for torque values at specific angles. Regarding composite variables, with one exception (functional flexion ratio from PTs obtained in different angles), all %CV were lower than 5% (3.36%-4.29%). The %CV for the functional ratio between PT of the cc action of the KF divided by the PT of the ecc action of the KE was 5.71%. For all measurements (simple and ratios) the ICC values were always over 0.95. Finally, Fig 1 illustrates the discrepancies of repeated measurement (Y-axes: session 2 minus session 1) for conventional ratio (panels A and B), for functional extension ratio (panels C and D) and for functional flexion ratios (panels E and F). The panels don’t suggest heterocedasticity among axes (with X-axes being the mean of the repeated measurement) neither by visual inspection of the graphic nor based on statistics.
Agreement of repeated measures for isokinetic ratios: conventional ratio (PT_KFcc/PT_KEcc; Panel A), angle-specific conventional ratio (T_KFcc at angle PT_KEcc/PT_KEcc; Panel B), functional extension ratio (PT_KFecc/PT_KEcc; Panel C), angle-specific functional extension ratio (T_KFecc at angle PT_KEcc/PT_KEcc; Panel D), functional flexion ratio (PT_KFcc/PT_KEecc; Panel E), and angle-specific functional flexion ratio (T_KFcc at angle PT_KEecc/PT_KEecc; Panel F). The relation between residuals (absolute mean differences between session 2 and session 1), the corresponding mean (heteroscedasticity diagnostic), and the 95% confidence intervals (95% CI) are also presented. The dashed lines represent 95% limits of agreement (±1.96 SD); lower limits of agreement (LLA) and upper limits of agreement (ULA).
Discussion
The present research examined the reliability of traditional and new isokinetic simple and combined indicators, resulting from KE and KF measurements in maximal cc and ecc tests performed at 60°·s-1. The main results showed suitable levels of systematic bias, absolute and relative reliability for PT, torque at specific angles, conventional and functional ratios, and conventional and functional ratios at specific angles, recorded from 26 adult male athletes who were tested on two separate occasions, with an interval of one week. Allowing for sample size, type of sports did not seem to affect the parameters under analysis.
The presence of systematic bias was assessed using the paired t-test and the magnitude effect. The paired t-test was able to detect statistically significant differences only in three of the thirteen studied isokinetic indicators: PT of KF in the cc test (lower on retest), torque of KF at angle of PT of KE in the cc test (lower on retest), and functional extension ratio at angle of PT of KE in the cc test (higher on retest, due to a non-significant increased ecc angle-specific flexor torque and a non-significant decreased cc extensor PT). Learning effects (better on retest) or fatigue effects (worse on retest) are the most probable explanations for systematic bias [22]. However, a one-week interval between test sessions appears to be sufficient to recover from the previous test, although these differences were primarily for the flexor muscles, which are usually less accustomed to producing maximal levels of muscle strength. Nevertheless, ten of the thirteen isokinetic indicators did not significantly differ between repeated time-moments and all magnitude effects were interpreted as trivial. Overall, the amount of systematic bias was acceptable. Lund et al. [25] tested thirteen healthy participants (9 women, 5 men; mean age: 32 years; range: 18–55 years) in 5 time-moments using a Biodex System 3 dynamometer and found no systematic effect over time for knee extension and flexion performed at 60°·s-1.
The absolute reliability was verified using TEM and (%)CV. Low TEM and CV below the proposed analytical goal of 5%, with the exception of the ecc knee flexion PT (5.2%) and functional flexion ratio (5.7%), suggested relatively little within-subject variation. Nevertheless, it is likely that measurement errors between sessions might be more related to biological or mechanical variation (i.e. random error) [22]. In a study by Birmingham et al. [26], a CV cut-off point of 8% resulted in correctly identification of 95% of maximal efforts.
The relative reliability was determined using the ICC. High ICCs for all the isokinetic indicators confirmed that the stability of the measurements over time was good. In general, the subjects maintained their position in the sample following the retest. Gleeson and Mercer [27] suggested that CV < 6.1% and ICCs ≥ 0.88 can be interpreted as suitable reliability in isokinetic strength testing. Lund et al. [25] reported ICCs ≥ 0.89 for KEcc and KFcc PT across 5 time-moments. Feiring et al. [28] also reported high ICCs for the KEcc (0.95) and KFcc (0.98) PT using a 7-days interval between testing sessions.
There is a lack of studies concerning the reliability of other isokinetic indicators, beyond the PT. Additionally, there are few studies that present results for KE and KF in cc and ecc actions using Biodex isokinetic dynamometers. Carvalho et al. [29] presented higher CV and lower ICCs for KEcc (%CV = 4.9–8.1; ICC = 0.89–0.95), KFcc (%CV = 3.9–16.5; ICC = 0.78–0.99), KEecc (%CV = 6.0–15.1; ICC = 0.74–0.95) and KFecc (%CV = 5.3–17.7; ICC = 0.72–0.97) using a closely related methodology of isokinetic testing in adolescent basketball players. At 60°·s-1, Ayala et al. [30] also presented higher CV and ICCs for KEcc (%CV = 16.45; ICC = 0.71), KFcc (%CV = 13.33; ICC = 0.78), KEecc (%CV = 17.09; ICC = 0.81) and KFecc (%CV = 8.99; ICC = 0.90) adopting a prone position.
The present study has several limitations that should be mentioned. The sample size was small, based on convenience and male subjects; therefore, the results are not generalizable. Further research in other populations is justified. Only two test sessions were considered; a third test session with an interval of one week could be more informative about the effect of familiarization between test sessions. Only the dominant lower limb was tested; further testing is necessary to assess the bilateral differences. Only tests performed at 60°·s-1 were used; further testing is necessary using other angular velocities, especially higher angular velocities when isokinetic dynamometers with higher sampling rates are available. The validity, responsiveness and clinical significance (especially relevant for subjects with knee injury) of the isokinetic indicators were not tested, issues that are lacking in the literature.
This information has practical implications in the management of research projects. Standardization of testing procedures is highly desirable, especially in terms of equipment calibration, warm-up procedures, familiarization training, number of submaximal trial repetitions, subject positioning and stabilization, axis alignment, testing setups, anatomical reference angle determination, verbal and/or visual feedback, gravity correction and testing protocol definition. Standardization of data collection, processing and analysis procedures are equally highly recommended.
Conclusions
In summary, results evidenced that the traditional and new isokinetic simple and combined indicators considered in this study are reliable to assess muscle strength and function in adult male athletes when derived from an isokinetic dynamometer that provides sampling rates of at least 100Hz, using a closely related methodology. Isokinetic indicators obtained during a single testing session seem to be sufficiently reliable. This can be especially important when it is not possible to bring the athletes to the laboratory prior to the test session for familiarization purposes. In fact, isokinetic dynamometry is considered the gold standard for the objective measurement of dynamic muscle strength and function. Strategies to minimize measurement error are of extreme relevance. New and ground-breaking concepts and methods for reporting reliable isokinetic data must also be explored, for example, considering angle-specific information in a more specific and meaningful manner.
References
- 1. Knapik JJ, Ramos MU. Isokinetic and isometric torque relationships in the human body. Arch Phys Med Rehabil. 1980; 61(2): 64–67. pmid:7369840
- 2. Baltzopoulos V, Brodie DA. Isokinetic dynamometry. Applications and limitations. Sports Med. 1989; 8(2): 101–116. pmid:2675256
- 3. Thistle HG, Hislop HJ, Moffroid M, Lowman EW. Isokinetic contraction: A new concept of resistive exercise. Acta Physiol Scand Suppl. 1967; 48(6): 279–282.
- 4. Aagaard P, Simonsen EB, Trolle M, Bangsbo J, Klausen K. Moment and power generation during maximal knee extensions performed at low and high speeds. Eur J Appl Physiol Occup Physiol. 1994; 69(5): 376–381. pmid:7875131
- 5. Thorstensson A. Muscle strength, fibre types and enzyme activities in man. Acta Physiol Scand Suppl. 1976; 443: 1–45. pmid:189574
- 6. Arnold BL, Perrin DH, Hellwig EV. The Reliability Of Three Isokinetic Knee-extension Angle-specific Torques. J Athl Train. 1993; 28(3): 227–229. pmid:16558236
- 7. De Ste Croix M, ElNagar YO, Iga J, Ayala F, James D. The impact of joint angle and movement velocity on sex differences in the functional hamstring/quadriceps ratio. Knee. 2017; 24(4): 745–750. pmid:28416087
- 8. Kannus P, Yasuda K. Value of isokinetic angle-specific torque measurements in normal and injured knees. Med Sci Sports Exerc. 1992; 24(3): 292–297. pmid:1549022
- 9. Aagaard P, Simonsen EB, Magnusson SP, Larsson B, Dyhre-Poulsen P. A new concept for isokinetic hamstring: quadriceps muscle strength ratio. Am J Sports Med. 1998; 26(2): 231–237. pmid:9548116
- 10. Baratta R, Solomonow M, Zhou BH, Letson D, Chuinard R, D'Ambrosia R. Muscular coactivation. The role of the antagonist musculature in maintaining knee stability. Am J Sports Med. 1988; 16(2): 113–122. pmid:3377094
- 11. Draganich LF, Jaeger RJ, Kralj AR. Coactivation of the hamstrings and quadriceps during extension of the knee. J Bone Joint Surg Am. 1989; 71(7): 1075–1081. pmid:2760083
- 12. More RC, Karras BT, Neiman R, Fritschy D, Woo SL, Daniel DM. Hamstrings—an anterior cruciate ligament protagonist. An in vitro study. Am J Sports Med. 1993; 21(2): 231–237. pmid:8465918
- 13. de Carvalho Froufe Andrade AC, Caserotti P, de Carvalho CM, de Azevedo Abade EA, da Eira Sampaio AJ. Reliability of Concentric, Eccentric and Isometric Knee Extension and Flexion when using the REV9000 Isokinetic Dynamometer. J Hum Kinet. 2013; 37: 47–53. pmid:24146704
- 14.
Lohmann TG, Roche AF, Martorell R. Anthropometric standardization reference manual, 3rd edn. Champaign, IL: Human Kinetics; 1988.
- 15.
Brown L. Isokinetics in human performance. Champaign, IL: Human Kinetics; 2000.
- 16. Drouin JM, Valovich-mcLeod TC, Shultz SJ, Gansneder BM, Perrin DH. Reliability and validity of the Biodex system 3 pro isokinetic dynamometer velocity, torque and position measurements. Eur J Appl Physiol. 2004; 91(1): 22–29. pmid:14508689
- 17. Osternig LR. Isokinetic dynamometry: implications for muscle testing and rehabilitation. Exerc Sport Sci Rev. 1986; 14: 45–80. pmid:3525192
- 18. Baltzopoulos V, Williams JG, Brodie DA. Sources of error in isokinetic dynamometry: effects of visual feedback on maximum torque. J Orthop Sports Phys Ther. 1991; 13(3): 138–142. pmid:18796847
- 19. De Ste Croix MB, Deighan MA, Ratel S, Armstrong N. Age- and sex-associated differences in isokinetic knee muscle endurance between young children and adults. Appl Physiol Nutr Metab. 2009; 34(4): 725–731. pmid:19767809
- 20.
Perrin DH. Isokinetic exercise and assessment. Champaign, IL: Human Kinetics; 1993.
- 21. Hopkins WG, Marshall SW, Batterham AM, Hanin J. Progressive statistics for studies in sports medicine and exercise science. Med Sci Sports Exerc. 2009; 41(1): 3–13. pmid:19092709
- 22. Atkinson G, Nevill AM. Statistical methods for assessing measurement error (reliability) in variables relevant to sports medicine. Sports Med. 1998; 26(4): 217–238. pmid:9820922
- 23. Currell K, Jeukendrup AE. Validity, reliability and sensitivity of measures of sporting performance. Sports Med. 2008; 38(4): 297–316. pmid:18348590
- 24. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986; 1(8476): 307–310. pmid:2868172
- 25. Lund H, Sondergaard K, Zachariassen T, Christensen R, Bulow P, Henriksen M, et al. Learning effect of isokinetic measurements in healthy subjects, and reliability and comparability of Biodex and Lido dynamometers. Clin Physiol Funct Imaging. 2005; 25(2): 75–82. pmid:15725305
- 26. Birmingham TB, Kramer JF. Identifying submaximal muscular effort: reliability of difference scores calculated from isometric and isokinetic measurements. Percept Mot Skills. 1998; 87(3 Pt 2): 1183–1191. pmid:10052075
- 27. Gleeson NP, Mercer TH. The utility of isokinetic dynamometry in the assessment of human muscle function. Sports Med. 1996; 21(1): 18–34. pmid:8771283
- 28. Feiring DC, Ellenbecker TS, Derscheid GL. Test-retest reliability of the biodex isokinetic dynamometer. J Orthop Sports Phys Ther. 1990, 11(7): 298–300. pmid:18796902
- 29. Carvalho HM, Coelho-e-Silva MJ, Ronque ER, Goncalves RS, Philippaerts RM, Malina RM. Assessment of reliability in isokinetic testing among adolescent basketball players. Medicina. 2011; 47(8): 446–452. pmid:22123556
- 30. Ayala F, De Ste Croix M, Sainz de Baranda P, Santonja F. Absolute reliability of isokinetic knee flexion and extension measurements adopting a prone position. Clin Physiol Funct Imaging. 2013; 33(1): 45–54. pmid:23216765