If you don't remember your password, you can reset it by entering your email address and clicking the Reset Password button. You will then receive an email that contains a secure link for resetting your password
If the address matches a valid account an email will be sent to __email__ with instructions for resetting your password
Address correspondence and reprint requests to: M.J. Thomas, Arthritis Research UK Primary Care Centre, Research Institute for Primary Care and Health Sciences, Keele University, Keele, Staffordshire, ST5 5BG, United Kingdom. Tel: 44-(0)-1782-734874; Fax: 44-(0)-1782-734719.
Arthritis Research UK Primary Care Centre, Research Institute for Primary Care and Health Sciences, Keele University, Keele, Staffordshire, ST5 5BG, United Kingdom
Arthritis Research UK Primary Care Centre, Research Institute for Primary Care and Health Sciences, Keele University, Keele, Staffordshire, ST5 5BG, United Kingdom
Arthritis Research UK Primary Care Centre, Research Institute for Primary Care and Health Sciences, Keele University, Keele, Staffordshire, ST5 5BG, United Kingdom
Arthritis Research UK Primary Care Centre, Research Institute for Primary Care and Health Sciences, Keele University, Keele, Staffordshire, ST5 5BG, United Kingdom
Arthritis Research UK Primary Care Centre, Research Institute for Primary Care and Health Sciences, Keele University, Keele, Staffordshire, ST5 5BG, United KingdomLower Extremity and Gait Studies Program, School of Allied Health, La Trobe University, Bundoora, Victoria, 3086, Australia
Arthritis Research UK Primary Care Centre, Research Institute for Primary Care and Health Sciences, Keele University, Keele, Staffordshire, ST5 5BG, United Kingdom
To derive a multivariable diagnostic model for symptomatic midfoot osteoarthritis (OA).
Methods
Information on potential risk factors and clinical manifestations of symptomatic midfoot OA was collected using a health survey and standardised clinical examination of a population-based sample of 274 adults aged ≥50 years with midfoot pain. Following univariable analysis, random intercept multi-level logistic regression modelling that accounted for clustered data was used to identify the presence of midfoot OA independently scored on plain radiographs (dorso-plantar and lateral views), and defined as a score of ≥2 for osteophytes or joint space narrowing in at least one of four joints (first and second cuneometatarsal, navicular-first cuneiform and talonavicular joints). Model performance was summarised using the calibration slope and area under the curve (AUC). Internal validation and sensitivity analyses explored model over-fitting and certain assumptions.
Results
Compared to persons with midfoot pain only, symptomatic midfoot OA was associated with measures of static foot posture and range-of-motion at subtalar and ankle joints. Arch Index was the only retained clinical variable in a model containing age, gender and body mass index. The final model was poorly calibrated (calibration slope, 0.64, 95% CI: 0.39, 0.89) and discrimination was fair-to-poor (AUC, 0.64, 95% CI: 0.58, 0.70). Final model sensitivity and specificity were 29.9% (95% CI: 22.7, 38.0) and 87.5% (95% CI: 82.9, 91.3), respectively. Bootstrapping revealed the model to be over-optimistic and performance was not improved using continuous predictors.
Conclusions
Brief clinical assessments provided only marginal information for identifying the presence of radiographic midfoot OA among community-dwelling persons with midfoot pain.
. Osteoarthritis (OA) is likely to be one underlying cause of foot pain. Among adults aged 50 years and over, 17% have been estimated to have symptomatic radiographic foot OA
The population prevalence of symptomatic radiographic foot osteoarthritis in community-dwelling older adults: cross-sectional findings from the Clinical Assessment Study of the Foot.
, however, the basis for clinically diagnosing foot OA in symptomatic individuals is far from clear.
At the knee, where more research has been undertaken, the European League Against Rheumatism (EULAR) guidelines recommend the clinical diagnosis of knee OA, and highlighted the particular risk factors, clinical history and physical examination findings likely to be most informative
and that symptomatic midfoot OA affects approximately 12% of adults aged 50 years and over, with most people reporting foot-related disability and recently utilising primary health care for foot pain
. Although often present in primary care, the ability to provide targeted treatment for the functional consequences of midfoot OA may be limited by the challenges of clinical diagnosis
“Somebody to say ‘come on we can sort this’”: a qualitative study of primary care consultation among older adults with symptomatic foot osteoarthritis.
Our aim was therefore to derive a clinically practicable multivariable diagnostic model for symptomatic midfoot OA among community-dwelling persons with midfoot pain.
Methods
Study population
Data were collected via a population-based health survey and research assessment clinic as part of the Clinical Assessment Study of the Foot (CASF)
The population prevalence of symptomatic radiographic foot osteoarthritis in community-dwelling older adults: cross-sectional findings from the Clinical Assessment Study of the Foot.
The clinical assessment study of the foot (CASF): study protocol for a prospective observational study of foot pain and foot osteoarthritis in the general population.
Individuals with non-specific inflammatory arthritis, rheumatoid arthritis or psoriatic arthritis, as indicated by primary care and local hospital medical record review, or on an X-ray report by a consultant musculoskeletal radiologist, were excluded from the analyses. Ethical approval was obtained from Coventry Research Ethics Committee (REC reference number: 10/H1210/5).
Data collection
Research assessment clinic attenders underwent standardised clinical interview and physical examination performed by one of seven trained research therapists (four physiotherapists, three podiatrists). Assessors had between 1 and 35 years of post-qualification experience, reflecting the broad range of expertise found in clinical practice, and were required to satisfy pre-study training requirements and undergo quality control sessions during the study
The clinical assessment study of the foot (CASF): study protocol for a prospective observational study of foot pain and foot osteoarthritis in the general population.
During the same research assessment clinic, plain radiographs were taken of both feet from weight-bearing dorso-plantar and lateral projections. All clinical assessors were blind to participants’ radiographic images and outcomes. The presence of midfoot OA was defined as a score of two or more for osteophytes or joint space narrowing at the first or second cuneometatarsal, navicular-first cuneiform or talonavicular joints on either dorso-plantar or lateral views. The included joints represent the medial midfoot region and were selected as the joints of the lateral midfoot were not included in the radiographic foot atlas as they could not be as reliably evaluated
by a single experienced reader (MM) who was blind to all clinical assessment outcomes. The radiographs of 60 participants were selected at random and were rescored 8 weeks later by MM and independently scored by HBM. Intra-rater reliability for the presence of midfoot OA in each foot was found to be excellent (mean unweighted κ = 0.90; 95% confidence interval (CI): 0.74, 0.99, mean percentage agreement = 95%) and inter-rater reliability was fair (mean unweighted κ = 0.32; 95% CI: 0.19, 0.45, mean percentage agreement = 63%).
Reference standard for symptomatic midfoot OA
Symptomatic midfoot OA was confirmed using the atlas by Menz et al.
and defined as the co-occurrence in the same foot of midfoot pain (ascertained from self-reported shading on a foot manikin as defined above) and the presence of radiographic OA (as defined above).
Selected predictor variables
A total of 16 predictor variables were selected from both health survey and research assessment clinic data. These were selected based on three criteria: (i) known risk factors for symptomatic OA at other joint sites, or (ii) have a mechanically-driven putative link to symptomatic midfoot OA, and (iii) be clinically practicable in primary care consultations. In meeting these criteria, three variables were identified and selected as recognised independent risk factors for OA (age, gender and body mass index (BMI))
. Age and gender were ascertained from the health survey and BMI was calculated from measured height and weight. Following pre-study consensus work with a multidisciplinary team of practicing clinicians, we selected static brief clinical assessments that could detect observable deficits, which will have direct implications for both static and dynamic loading of the midfoot. These included the following:
Static foot posture
i)
Arch Index: ratio of middle third area to the whole foot area, excluding toes, calculated from carbon footprints taken in relaxed bipedal standing. Higher Arch Index ratios indicate lower arch
Foot Posture Index: 6-item assessment performed in relaxed bipedal standing. A summative score (range, −12 to +12) classified feet as supinated, normal or pronated
Navicular height: height of the navicular tuberosity from the floor in relaxed bipedal standing, measured in millimetres with a ruler, and normalised for foot size by dividing by foot length
First MTPJ dorsiflexion ROM: maximum passive hallux extension, measured in degrees using a goniometer in non-weight-bearing with the ankle in a relaxed position and the first ray allowed to freely plantarflex
Heel pain – plantar fasciitis: clinical practice guidelines linked to the international classification of function, disability, and health from the orthopaedic section of the American Physical Therapy Association.
Lesser toe deformity: palpable presence or absence of deformities, in one or more lesser toes, including mallet, hammer and claw toe in non-weight-bearing and retracted toe observed in standing
Hallux valgus: ascertained using five line drawings of the foot progressing in severity (15° increments) using a validated self-report instrument and dichotomised present or absent definition (three most severe vs two least severe)
For Arch Index, navicular height, 1st MTPJ dorsiflexion, subtalar inversion/eversion and ankle dorsiflexion with the knee flexed/extended, intra-class correlation coefficients (ICC) previously reported for intra-rater reliability range from 0.82–0.99
All feet with midfoot pain were entered into the analysis. All continuous variables were screened to check appropriate range values and to identify any apparent outliers
. Where possible, dichotomised or categorised cut-offs applied to continuous variables were based on previous evidence. Across all feet, navicular height was divided into tertiles on the variable distribution to produce categories consistent with the Arch Index, and the subtalar and ankle ROM variables were dichotomised on the median, as no suitable prior information was identified. As the proportion of missing data for each predictor variable was <5%, multiple imputation was considered unnecessary.
The data had a non-hierarchical structure with feet nested within person and were analysed using a random intercept multi-level logistic regression model
. Each predictor variable was individually entered into the model with presence of symptomatic midfoot OA as the outcome. Significant independent predictor variables (P < 0.25 from likelihood ratio tests
) were then simultaneously entered into the model with age, gender and BMI force-entered, and manual backward elimination of variables (P = 0.05) performed. The final model was refitted using data from participants with no missing predictor variable data. Predicted risks were calculated on the estimated variable effects and the intercept for each foot. The proportion of the sample that could be correctly classified (ruled-in as having symptomatic midfoot OA) or correctly classified as midfoot pain (ruled-out for symptomatic midfoot OA) was determined by imposing a practical cut-off of 50%. Subsequently, sensitivity and specificity with 95% CIs were calculated for the overall final model.
Model performance was assessed with the calibration slope and area under the curve (AUC). Ideally a calibration slope with a value of 1 indicates the predicted and observed risks are the same
. Model performance was then compared with a model containing age, gender and BMI only.
The internal validity of the final derived model and the performance measures were evaluated using 1000 bias-corrected bootstrap samples with replacement resampling on clusters, i.e., at the person level
. Using the bias-corrected bootstrap model, sensitivity and specificity were re-estimated.
Although dichotomising or categorising continuous predictors arguably assists clinical interpretability, it has been criticised for resulting in a loss of information and poorly fitting models
. We therefore re-ran the model-fitting procedures with all continuous predictor variables in their original form. The six-items of the Foot Posture Index that generate a summative score were Rasch-transformed into a single interval score, previously shown to improve internal construct validity
. All analyses were conducted using STATA V.13.0 (Stata Corporation, Texas, USA).
Results
Study participants
Of the 560 participants who attended the research assessment clinic between June 2010 and September 2011, 525 were potentially eligible for this analysis following the exclusion of individuals with incomplete pain data (n = 8), absent radiographic data (n = 3) and inflammatory arthritis (n = 24). This left 525 participants with foot pain and radiographic data, of whom 274 participants had both midfoot pain and complete radiographic data. Of these participants, 155 (57%) had midfoot pain only and 119 (43%) had symptomatic midfoot OA. From this sample of individuals, there were 263 feet with midfoot pain only and 149 with symptomatic midfoot OA (Fig. 1). Mean age (±SD) was 65.0 (8.6) years (age range 50–87), and 54% were female.
Fig. 1Flowchart of clinic attenders into analysis.
All clinical values for each predictor variable appeared appropriate and no data distributions were unduly influenced by outliers.
Diagnostic model
Of the 16 selected predictor variables, 10 were associated with the outcome (P < 0.25 from likelihood ratio tests) (Table I). These were age, BMI, Arch Index, Foot Posture Index, navicular height, subtalar inversion, ankle dorsiflexion with the knee flexed, midfoot exostosis, plantar fascia insertion tenderness and lesser toe deformity. Although gender was not statistically significant (P = 0.28), this was also a retained force-entered variable, due to previously established and consistent links with OA.
Table IDescriptive characteristics and univariable analysis for the occurrence of symptomatic midfoot OA
Predictor variable (categorisation)
Total
Midfoot pain
Symptomatic midfoot OA
Multi-level logistic regression Midfoot pain vs symptomatic midfoot OA P
Manual backward selection was performed on 262 participants with complete data on all the included predictor variables and produced a final model with six parameters from four variables. These included the three force-entered variables (age, gender and BMI) and Arch Index. The final model was refitted to 269 participants with complete data on the retained predictor variables (Table II).
Table IIMultivariable multi-level logistic regression model for symptomatic midfoot OA
Predictor variable
Total
Symptomatic midfoot OA
Multi-level logistic regression Midfoot pain vs symptomatic midfoot OA
The model fit was poor for the observed data (calibration slope, 0.64, 95% CI: 0.39, 0.89). Although Arch Index was marginally informative when added to age, gender and BMI, discrimination remained fair-to-poor (AUC, 0.64, 95% CI: 0.58, 0.70 vs 0.62, 95% CI: 0.57, 0.68). For the overall model, sensitivity was 29.9% (95% CI: 22.7, 38.0) and specificity was 87.5% (95% CI: 82.9, 91.3).
Comparison of the beta coefficients and odds ratios for the final derived model (Table II) and the same estimates following bias-corrected bootstrapping indicated the model to be over-optimistic (data not shown). Overall bias-corrected model sensitivity was 25.9% (95% CI: 19.0, 33.7) and specificity was 89.9% (95% CI: 85.5, 93.3).
Sensitivity analyses
Repeating the modelling with variables in their original continuous form, did not identify any additional predictors, and overall model performance was effectively unchanged (calibration slope, 0.61, 95% CI: 0.38, 0.85; AUC, 0.66, 95% CI: 0.60, 0.71; sensitivity, 53.2%, 95% CI: 41.5, 64.7; specificity, 67.6%, 95% CI: 62.2, 72.6) (data not shown).
Discussion
Our study found that in a population-based sample of adults aged 50 years and older with midfoot pain, brief clinical assessments added little to age, gender and BMI in the discrimination of individuals with underlying midfoot OA on plain radiographs from those without these structural changes. Although several physical examination variables were associated with symptomatic midfoot OA, these were often either too weakly associated to be included in a diagnostic model (Foot Posture Index, subtalar inversion, plantar fascia insertion tenderness and lesser toe deformity) or lacked strong association after adjusting for age (navicular height) or combinations of age, gender, BMI and Arch Index (ankle dorsiflexion with the knee flexed and midfoot exostosis). The retained Arch Index predictor, indicating a more pronated foot posture among those with symptomatic midfoot OA, would appear to be biologically plausible and is consistent with earlier observations
. In isolation, the Arch Index appeared to be a potentially useful predictor of symptomatic midfoot OA.
Although the low overall bias-corrected sensitivity (25.9%) is accompanied by a high specificity (89.9%), considered together with an AUC of 0.64, the final model remains only fair-to-poor at discriminating between people with and without symptomatic midfoot OA.
Accurate clinical diagnosis of symptomatic OA compared to plain radiographs has been mixed at other joint sites including the knee
. At the foot, a diagnostic model developed to predict the presence of radiographic OA at the first MTPJ in adults with first MTPJ pain reported better performance than the present model (AUC, 0.87, 95% CI: 0.80, 0.93)
study, compared to the broader foot examination we used to identify radiographic OA in the midfoot complex.
Strengths of this study are the population-based sample and standardised quality-controlled protocol for the collection of clinical and radiographic data. Despite this, there are a number of methodological issues that may explain the fair-to-poor performance of the model. First, the selected predictors may lack discriminatory ability. Even if measured perfectly, these clinical assessments may not be very strongly associated with the presence/absence of radiographic OA. For example, if they are causes of midfoot OA, they may be relatively weak causes, or if they are manifestations of midfoot OA, they may provide relatively weak signals. The strength of univariable association required for adequate discrimination is very high
. Given the complex pathogenesis and structure/pain associations in OA, discrimination from any one single measure is unlikely, which supports the need to evaluate multivariable clinical assessment models. The present model examined 16 predictor variables, however soft tissue assessments such as posterior tibial tendon dysfunction or local swelling and tenderness were not considered. It is possible that our model could be improved by adding more clinical predictors or other diagnostic markers
Second, random and systematic errors in the clinical assessment measurements may also influence our findings. All assessors undertook protocol training and quality control monitoring, and we also chose clinical assessments previously shown to be reliable. However, we did not formally evaluate the reliability of clinical assessments within this study.
Third, symptomatic midfoot OA in an individual joint was defined as ≥2 for osteophytes or joint space narrowing using the scoring system established by Menz et al.
. With nearly half (43%) of the 274 eligible participants comprising the study sample having radiographic midfoot OA, this underscores the very high prevalence among older adults that report midfoot pain. Of the 263 feet with midfoot pain but classed as ‘no midfoot radiographic OA’, 248 (94%) had a score of one. Whilst grade one radiographic changes did not meet our threshold for symptomatic midfoot OA, it may be that disease manifestations and variations in structural appearance between grade one and two are too subtle to be clinically discernible. Recent work on knee OA has shown that grade one is a strong predictor of future grade two
. This suggests that grade one may have been a more suitable cut-off. Since it is not possible to know from this sample what the prevalence of grade one midfoot changes may be in an asymptomatic population, a question for future research is whether midfoot pain alone in adults aged 50 years and over without inflammatory arthritis provides adequate grounds for ‘ruling in’ symptomatic midfoot OA.
By assembling the sample from a cohort of individuals with foot pain in the last 12 months, it is possible that participants may have had concurrent symptoms elsewhere in their foot. Restricting analysis to individuals with foot pain only in the midfoot region was not possible due to small numbers. A sensitivity analysis, where univariable analyses for all predictor variables (excluding the force-entered variables: age, gender and BMI) was repeated after excluding 33 individuals with symptomatic first MTPJ OA (defined as co-occurring pain and radiographic change as defined above), indicated that 14 of the 16 observed associations had similar magnitude and precision that would not have statistically significantly altered the model (data not shown). Although the four selected joints can be reliably scored and used to represent midfoot OA, this present analysis pertains only to the identification of radiographic OA in the medial midfoot. Whilst clinically the occurrence of OA in the lateral midfoot is understood to be rare by comparison
, osteoarthritic changes in other midfoot joints could also contribute to symptoms in both midfoot pain and symptomatic midfoot OA groups. Furthermore, an alternative reference standard such as magnetic resonance imaging (MRI) or ultrasound may have generated different results and future studies could consider comparing the use of other imaging modalities for the foot.
Finally, misclassification may have arisen in the musculoskeletal midfoot pain domain. Narrowing this domain to exclude those with prevalent conditions such as diabetes, peripheral vascular disease or gout may help in being able to diagnose symptomatic midfoot OA, but this would also limit the generalizability of such insights as multimorbidity is often quite high in this age group. Of the 274 participants in this sample, 19% and 37% had self-reported diabetes and peripheral vascular disease respectively. Only 5% had a primary care consultation for gout within 18 months either side of research clinic attendance.
The population-based recruitment for this study meant that although the spectrum of severity across the sample is likely to be mild, this has relevance for primary care. Furthermore, although a physical examination may be of limited value for discriminating the presence or absence of symptomatic midfoot OA, brief clinical assessments may be better used to identify abnormal structural and postural presentations that could inform more targeted treatments.
In summary, this study did not allow development of a clinically practicable diagnostic model for symptomatic midfoot OA. Person-level information including age, gender and BMI provided only marginal diagnostic information and only very minor additional improvements in model performance were achieved with brief clinical assessment information. Before primary care clinicians can be confident that the diagnosis of symptomatic midfoot OA necessitates the use of X-ray, future research should examine whether these or other, more anatomically-specific, clinical assessments can show better discrimination in other samples, using alternative modelling techniques, or compared to other imaging modalities such as MRI and ultrasound.
Contributions
MJT, ER, GP, AM and HBM conceived the study. MJT, ER, GP and AM designed the study. MJT, ER and MM were responsible for data acquisition. Analysis was undertaken by MJT and TR. All authors interpreted data, drafted or revised the article critically for important intellectual content, and approved the final version of the manuscript.
Funding
This work was funded by an Arthritis Research UK Programme Grant (18174) and service support through West Midlands North CLRN. The study funders had no role in the study design; data collection, analysis or interpretation; in the writing of the paper; or in the decision to submit the paper for publication. MJT was supported by West Midlands Strategic Health Authority through a Nursing, Midwifery, and Allied Health Professionals Doctoral Research Training Fellowship (NMAHP/RTF/10/02). HBM is currently a National Health and Medical Research Council of Australia Senior Research Fellow (ID: 1020925).
Conflicts of interest
The authors have no conflicts of interest to declare.
The population prevalence of symptomatic radiographic foot osteoarthritis in community-dwelling older adults: cross-sectional findings from the Clinical Assessment Study of the Foot.
“Somebody to say ‘come on we can sort this’”: a qualitative study of primary care consultation among older adults with symptomatic foot osteoarthritis.
The clinical assessment study of the foot (CASF): study protocol for a prospective observational study of foot pain and foot osteoarthritis in the general population.
Heel pain – plantar fasciitis: clinical practice guidelines linked to the international classification of function, disability, and health from the orthopaedic section of the American Physical Therapy Association.