Navigating the learning curve: assessing caseload and comparing outcomes before and after the learning curve of computer-navigated total hip arthroplasty

On June 16, 2023, a search was conducted using PubMed, MEDLINE, EBSCOhost, and Google Scholar to find studies that assessed the learning curve for RA- and CN-THA that were published between January 1, 2000, and June 16, 2023. The Boolean operators “AND” or “OR” were combined with the following keywords and Medical Subject Headings (Mesh): (“Arthroplasty, Replacement, Hip”[Mesh] OR “Arthroplasty, Replacement”[Mesh] OR “total hip arthroplasty” OR “THA”) AND (“Robotics”[Mesh] OR “robotic*” OR “Surgery, Computer-Assisted”[Mesh] OR “Robotic Surgical Procedures”[Mesh] OR “robotic arm” OR “computer navigated”) AND (“Learning Curve”[Mesh] OR “learning” OR “curve” OR “train*” OR “skill*” OR “development” OR “education” OR “proficiency”).

Eligible articles included studies that had (1) full-text manuscripts in English and (2) evaluated the learning curve in adopting CN-THA. The following articles were excluded from the analysis: (1) case reports, (2) reviews, (3) duplicate articles, (4) gray literature (preprint server articles, posters, and abstracts), and (5) articles not written in English.

The Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines were followed in conducting this review (PROSPERO registration: CRD42023394031, June 27, 2023). After deleting duplicates, 655 articles were returned by the query. Each unique article retrieved via the search term was evaluated for eligibility by two independent reviewers (PAS, JRP). To reach consensus, any differences were consulted with a third reviewer (CJH). Forty-eight papers were eligible for a full-text evaluation after title and abstract screening, with nine meeting all criteria for inclusion in the present analysis. No further studies were found when the reference lists for each article were reviewed (Fig. 1).

Using the MINORS tool, two independent reviewers (PAS, JRP) evaluated the bias risk [26]. Using 12 criteria regarding the rigor of the study design, outcomes assessed, and follow-up, this verified grading method assigns comparative studies a score between 0 and 24, with higher scores denoting higher quality research. Grading disagreements were settled by reaching a consensus with a third reviewer (CJH). The average MINORS score was 21.3 ± 1.2.

Two methods were used to evaluate the learning curve: (1) temporally evaluating a surgeon’s performance over their initial versus later CN-THA cases and (2) comparatively comparing initial CN-THA case outcomes versus outcomes achieved via other THA approaches (namely M-THA). Outcomes of interest included operative time, accuracy of acetabular component placement, radiographic accuracy (LLD and offset), functional outcomes, radiation exposure, and postoperative adverse events. No studies included in the review compared complication profiles during the learning curve. The accuracy of acetabular component placement was assessed with anteversion and inclination (i.e., average values, target value deviations, and safe zone outliers). As the included studies had substantial methodologic heterogeneity, a meta-analysis was not conducted; rather, we conducted a narrative synthesis by presenting and synthesizing key findings. When available, we reported quantitative data for positive findings and qualitative data for negative findings. Likewise, due to substantial heterogeneity in the comparison cohorts among studies, we were unable to visually represent the acetabular component placement accuracy metrics via Bland-Altman plots for both the temporal and comparative assessments of the CN-THA learning curve.

Included in the final analysis were a total of nine studies assessing 847 THAs [21‐25, 27‐30] (Table 1). Six studies assessed the learning curve temporally [21, 23, 25, 27‐29] and six assessed the curve comparatively [22‐24, 28‐30]. Patient characteristics, follow-up timeframes, THA approach, type of acetabular implant, and computer-navigated platform utilized varied among articles (Table 1).

Of the six studies that assessed the learning curve of CN-THA temporally, five divided the surgeon’s initial cases into cohorts and compared early cases to later [21, 25, 27‐29] (Table 2). Two of these studies compared the first 20 procedures to a group of later ones [21, 28], with one showing marked improvements in cup medialization accuracy after 20 cases, but no difference in deviation from planned cup height, anteversion, or inclination, or mean LLD [21]. However, the other study showed marked improvement in anteversion and inclination accuracy, as more components were placed within the target zone after 20 cases (44% vs 87%) [28]. Another study compared the surgeon’s initial 49 cases to 47 cases thereafter, showing a decrease in deviation from planned anteversion (1.04° vs 0.85°) and inclination (0.88° to 0.69°), though no change in operative time [29]. Thorey et al. [25] demonstrated marked differences between intraoperative and radiographic anteversion (15.1° vs 20.9°) and inclination (43.7° vs 47.3°) in cases 1–30, but found no difference in intraoperative versus measured values in cases 31–60. Additionally, navigation time was lessened after 30 cases (13.2 vs 4.8 min). Meanwhile, a remaining study reported a marked decrease in operative time after five cases, though no change in deviation from planned cup inclination or anteversion with experience [27].

Of the six studies that assessed the learning curve of CN-THA comparatively, three compared a surgeon's initial navigated procedures to past conventional procedures they had performed, with one showing marked increases in cups placed within the surgeon’s combined target zone with navigation (30% vs 6%) [28] and another showing fewer ≥ 10° outliers in anteversion (14% vs 21%) and inclination (4% vs 13%) [29] (Table 3). Additionally, one of these studies showed increased operative time for CN-THA (+ 20 min), with little improvement when comparing the early navigated cases (cases 1–49: 128 min), to the later cases (cases 50–96: 124 min) [29]; though another study showed only a modest increase in operative time for CN-THA compared to M-THA (+ 3 min)[24]. Another study compared a surgeon’s initial CN-THA procedures to fluoroscopically guided procedures they had performed, with handheld navigation demonstrating lower deviation from planned inclination (2.9° vs 3.4°) and a longer operative time (92 vs 72 min) over the first 30 cases [23]. After 35 cases, handheld navigation demonstrated lower deviation from planned anteversion (2.0° vs 5.8°) and inclination (1.3° vs 5.4°), lower LLD (1.0 vs 3.4 mm) and offset (1.4 vs 6.1 mm), fewer ≥ 10° outliers for version (0% vs 20%) and inclination (0% vs 15%), and reduced radiation time and dose (dose: 0.6 vs 2.1 mGy; time: 5.3 vs 19.1 s) compared to fluoroscopically guided THA.

Several studies investigating the learning curve for CN-THA similarly chose to track the progress of the surgeon over their initial series of navigated procedures. However, CUSUM analysis was not utilized, which may reflect the CN-THA studies having been conducted before CUSUM was popularized. Most studies instead employed a predetermined case number in the series to compare early cases to later ones. The case number chosen to delineate early from later cases was left to the authors’ discretion and varied greatly, between 20 and 50 cases. There were mixed findings regarding the case number required to achieve peak component placement accuracy, which may be a reflection of the limited accuracy of the approach used to analyze the curve as well the fact that different navigation platforms were used. While these studies aimed at estimating an inflection, CUSUM analysis was able to provide an exact case number based on the metric analyzed. Thus, a more standardized approach to the analysis of surgical learning curves in future investigations may allow for more accurate information on the learning process involved with THA technologies and enable direct comparison of available platforms.

The use of CN-THA also demonstrated immediate advantages in acetabular component placement accuracy but came with an increased operative time as compared to M-THA. Kolodychuk et al. [23] compared CN-THA to fluoroscopically guided THA and demonstrated that while handheld navigation offered immediate advantages in component inclination accuracy, operative time was initially longer. However, after 35 cases, there was no difference in operative time between approaches and CN-THA began to demonstrate additional advantages, including markedly lower LLD, offset, and radiation time and dose, as well as further improvements in component placement accuracy. Therefore, while CN-THA provides immediate advantages in component placement accuracy and radiographic outcomes, these advantages become more pronounced as experience is acquired. While CUSUM has typically been used to analyze operative time as the outcome of interest, future analyses using alternative outcomes, such as placement accuracy, LLD, offset, and functional outcomes, can provide a clearer understanding of the learning curve required to achieve peak proficiency in CN-THA.

This study had its limitations, many of which resulted from heterogeneity between studies, including the methodologies used to assess the learning curve, navigation platforms, implants, and surgical approaches used, and the statistical analysis of outcomes. As a quantitative synthesis of the evidence was infeasible, and the authors conducted a narrative analysis instead. Additionally, this heterogeneity also prevented direct comparisons between the CN-THA platforms assessed. Furthermore, as the analysis was compromised of observational cohort studies, there is a greater risk of bias in the included studies. Similarly, the intrinsic mean error of each CN-THA platform differs and impacts the overall final placement accuracy of the system, therefore influencing results. Also, none of the included studies assessed complications during the learning curve of CN-THA compared to M-THA, which is a key factor to consider when deciding whether to adopt CN-THA.