The purpose of this study is to evaluate and compare publishing characteristics in foot and ankle trauma articles published in two subspecialty journals and two general orthopedic journals.
All trauma articles related to foot and ankle surgery published from five different time intervals over a 20-year period were collected and the following was analyzed: authorship, level of evidence, type of study, citations, and geographic region.
Foot and Ankle International (FAI) had the highest percentage of last and corresponding authors that were fellowship-trained in foot and ankle. The Journal of Bone and Joint Surgery American and British volumes (JBJS(A) and JBJS(B), respectively) and the Journal of Orthopaedic Trauma (JOT) articles had a higher percentage of last and corresponding authors that were fellowship-trained in trauma.
Foot and ankle-trained authors are currently under-represented in foot and ankle trauma literature. As the field of foot and ankle continues to grow, it is important that the experts in the field are well represented in the literature.
As the field of foot and ankle surgery continues to grow and progress, it is essential that the quality of research in this area does the same. With more academic literature being published each year , greater emphasis is continually being put on the quality of clinical research and supporting evidence in published articles. Several studies in orthopedic literature have noted the increase in number of authors over time, level of evidence (LOE), and number of international author groups [2-8]. To date, there are no studies evaluating publications covering traumatic foot and ankle conditions and how these publications vary amongst different journals.
The purpose of this study is to evaluate and compare publishing characteristics in foot and ankle trauma articles published in two subspecialty journals, Foot and Ankle International (FAI) and the Journal of Orthopaedic Trauma (JOT), and two general orthopedic journals, the Journal of Bone and Joint Surgery American and British volumes (JBJS(A) and JBJS(B), respectively), at five different time intervals over a 20-year period. Publishing characteristics analyzed included authorship, level of evidence, article type, citations, and geographic origin of authors trends.
This review will provide insight into the quality of foot and ankle trauma literature being published in a variety of orthopedic journals and see if similar characteristics exist between journals.
Materials & Methods
Using the FAI, JOT, JBJS(A), and JBJS(B) archives, we collected all trauma articles related to foot and ankle surgery articles published from five different time intervals over a 20-year period. Journal selection was decided by impact factor. JOT and FAI represent the highest impact factors for trauma and foot and ankle publications, respectively. JBJS(A) holds the highest impact factor for general orthopedic journals . Due to the low amount of trauma-related foot and ankle articles published in JBJS(A), JBJS(B) was also included to increase the amount of reviewed articles from a general orthopedic journal. The intervals included: January 1, 1997 to December 31, 1997; January 1, 2002 to December 31, 2002; January 1, 2007 to December 31, 2007; January 1, 2012 to December 31, 2012; and January 1, 2017 to December 31, 2017.
Exclusions and citations
Inclusion criteria included all trauma articles related to foot and ankle surgery from the years 1997, 2002, 2007, 2012, and 2017. Editorials, letters to the editor, announcements, technical notes, events, errata, retracted manuscripts, historical papers, and articles covering chronic foot pathology were excluded. After exclusions were made there were 147 foot and ankle articles published in FAI, JOT, JBJS(A), and JBJS(B) over the 20-year period. Information related to each article including number of authors, the highest level of education of the authors that were publishing, study design, and country of origin was recorded. Additionally, a Google Scholar search was conducted for each article to determine the number of times an article had been cited .
Fellowship and attending status
The American Board of Orthopaedics Surgery certificate verification tool was used to determine if an author was a resident or attending. To account for the lag time between residency and board certification we counted authors as attendings only if they had been certified for greater than two years at the date of article publication. To determine the fellowship training of authors, all authors that completed their residency in the United States were then searched in Google® using their name combined with: “orthopedic trauma fellowship,” “orthopedic foot and ankle fellowship,” “orthopedic fellowship,” the name of the institution that was associated with their published article, and “fellowship.” The first two pages of search results were viewed. Only articles from the United States were analyzed for author fellowship training due to variations in training globally.
Review of level of evidence
Two reviewers independently reviewed the articles and assigned an LOE and article type. The level of evidence was assigned on a scale of I to V. Level I was the highest grade that an article could receive. For the articles that received two different LOE grades, a discussion was had between the two reviewers until a decision was reached. If the two reviewers could not reach an agreement, they had a discussion with the senior author, and the methodology proposed by Spindler et al. was used to make a final decision . Small case series of five or fewer patients that were a compilation of multiple case reports were assigned as “case reports,” despite having more than two patients. These studies were assigned an LOE grade of V. Larger case series reporting on patient cohorts were labeled as either a therapeutic, prognostic, or diagnostic study. These studies were assigned an LOE grade of IV. Animal, cadaver, basic science articles, and case reports were included and were assigned an LOE of V.
The kappa coefficient was used to measure interobserver agreement for LOE. Publication characteristics were compared over time and with respect to LOE. All categorical variables were compared using chi-square and Fisher’s exact tests (when individual cell count was less than five); the Kruskal-Wallis test was used for comparisons involving count variables.
The kappa value for the interobserver reliability of the LOE for each article, k = 0.96, showed an almost perfect agreement between the reviewers.
The median number of authors was highest at five in JBJS(A)(B) despite not hitting significance (Table 1). FAI had a significantly higher median (0) and mean (0.708) number of MD/PhDs (p= .031 and .018, respectively), but no other authorship trends differed significantly between the four journals. JBJS(A)(B) had the highest percentage of last and corresponding authors that were PhDs (16.7% and 12.5%, respectively).
The results for fellowship training only pertain to articles that were connected to institutions within the United States. Eighty-one articles were analyzed (Table 2). JBJS(A)(B) articles had a higher percentage of last (72.7%) and corresponding authors (45.5%) that were fellowship-trained in trauma (p= .009 and p= .028, respectively). FAI had the highest percentage of last (28.6%) and corresponding authors (36.1%) that were fellowship-trained in foot and ankle (p= .011 and .0003, respectively). The median number of authors that were residents was one for each journal. The median number of authors that were attendings was highest for JOT at three.
Level of evidence and type of study
The percentage of level I (12.5%) and II (12.5%) articles were highest in JBJS(A)(B) (Table 3). FAI and JBJS(A)(B) had a higher percentage of level III evidence articles (25.0% and 29.17%, respectively) compared to JOT (13.56%). The distribution of level V evidence articles was greater in JOT (37.29%) compared to FAI and JBJS(A)(B) (23.44% and 0%, respectively).
The four journals, FAI, JOT, and JBJS(A)(B), had a similar distribution of clinical therapeutic and clinical diagnostic studies (Table 3). JBJS(A)(B) had a greater number of clinical prognostic studies (50.0%) compared to JOT and FAI (8.47% and 21.88%, respectively). There were no case reports in JBJS(A)(B). The percentage of anatomic studies was highest in JOT at 8.47%.
Citations and geographic region
The median number of citations per year per article was significantly higher in JBJS(A)(B) (p= .022) (Table 3). A majority of articles published in each journal were from groups based in the United States. JBJS(A)(B) had the highest percent of articles from European countries compared to FAI and JOT (Table 3). FAI had the highest percent of articles from Asian countries (9.4%), and JOT had the highest percent of articles that were the result of international collaboration (6.8%).
Publication trends over time
Several trends were noted amongst all articles across five time intervals over a 20-year period (Table 4). A noticeable shift in LOE of the articles being published occurred, as a smaller percentage of articles being published recently feature Level 1 evidence compared to 20 years ago. Level I evidence articles decreased from 14.81% of articles in 1997 to 4.88% in 2017. Instead, more level III and IV evidence articles are being published. In 2017, level III and IV evidence articles comprised 43.9% and 41.46% of all the articles in this study, respectively. There was a significant decrease in the amount of level V evidence articles being published from 48.15% in 1997 to 9.76% in 2017 (p= .0006).
The number of case reports has decreased from 33.33% of published articles in 1997 to 2.44% in 2017 (Table 4). Anatomic and biomechanical studies have also seen a decrease from 11.11% in 1997 to 2.44% in 2017. As of 2017, a majority of clinical studies being published are therapeutic and prognostic.
While the orthopedic subspecialty of foot and ankle continues to advance and grow, it is important that a high quality of research in this field is maintained; however, there are no studies to date evaluating the quality, primarily based on LOE and citation counts, of research in foot and ankle trauma publications. This study is novel in both this regard and in its analysis of fellowship training of authors.
By evaluating the fellowship training of the last and corresponding author, it is possible to gain greater insight into the perspective from which many of the studies are being conducted. It can be reasonably presumed that orthopedic specialists, whether in foot and ankle or trauma, are more inclined to conduct research with principles and ideas that are related to the training they received during fellowship. This is compared to authors who did not receive fellowship training after completion of their residency.
The goal of this study is to compare two subspecialty journals, FAI and JOT, and two general orthopedic journals, JBJS(A)(B), in order to see any differences in publishing characteristics between the journals through evaluating authorship characteristics, LOE, type of study, and citations across the four journals and over a 20-year time period. Additionally, this study has identified temporal trends across all articles. This review provides a comprehensive view of the current state of foot and ankle trauma research and the direction that it is headed.
Authorship and fellowship training
Between the journals, no major trends in the distribution of authors were noted, but while the median number of MD/PhD authors per article was zero for all four journals, the mean number of authors with an MD/PhD was significantly higher in JBJS(A)(B). The increased involvement of MD/PhDs may lead to higher-quality publications. These authors may draw on their PhD training to design larger prospective studies. Each journal exhibited similar numbers per article of MDs, PhDs, and other degrees. The similarities between journals are comparable to the authorship characteristics found in other orthopedic specialties and journals [2,12].
Comparing fellowship training data across journals, FAI shows a significantly greater proportion of articles by foot and ankle-trained authors than either JOT or JBJS(A)(B), but these proportions highlight the relatively low overall percentage of foot and ankle-trained last and corresponding authors (28.6% and 36.1%, respectively). Conversely, JOT and JBJS(A)(B) have significantly greater proportions of articles by trauma-trained authors than FAI. Fellowship training of authors was only analyzed for United States articles in this study, and the status of fellowship training of authors in non-United States articles is unknown. Of note, no other studies evaluating the fellowship status of authors in orthopedic literature were found to use as a comparison, so average proportions of fellowship-trained authors in the literature are largely unknown at the present time. The overall lack of articles by foot and ankle-trained authors compared to trauma specialists, however, shows the current under-representation of publications by these experts. The need for foot and ankle specialists to be better represented in foot and ankle trauma literature is evident and important for a more comprehensive perspective on this important topic.
Level of evidence and study design
Consistent with previous orthopedic studies of similar design, the greatest proportion of publications in all four journals in the study were level III evidence and lower [3,4]. FAI and JOT both had high percentages of level V evidence studies at 23.4% and 37.3%, respectively. Various reasons have been proposed for the consistently high number of lower evidence articles including the difficulty of randomized controlled trials (RCTs) in surgical studies and the relative financial and time advantage of lower LOE studies compared to RCTs . Due to the nature of trauma research, cadaver and biomechanical studies can provide valuable insight and surgical guidance. When considering the subject matter of JOT, the fairly high number of level V evidence studies is reasonable. Interestingly, a greater proportion of level I and II evidence articles was seen in each journal in this analysis than in a foot and ankle LOE study looking at the same journals .
It should be noted that a study being a lower level of evidence does not inherently mean that it is a lesser study. The value of high level of evidence studies should not be disregarded. These studies use less mechanism-based reasoning and are more clinically applicable; however, all study types have a role in the literature and help the field advance and grow.
Type of study
A majority of articles were clinical therapeutic in nature for each journal, making up at least 38% of the articles in all four journals. These results agree with the findings of similar trend studies in orthopedics that analyzed study type [3,4]. The emphasis on this study type demonstrates the importance of identifying and improving treatment methods within the field of orthopedics. There was a significant difference in the amount of clinical prognostic studies published by each journal. JBJS(A)(B) articles published the highest amount of prognostic studies (50%) which was significantly higher than both FAI and JOT. The prominent number of clinical prognostic studies in both FAI and JBJS(A)(B) highlight the academic nature of these journals in their commitment to publishing studies that provide long-term follow-up data to accurately reflect the course of orthopedic injuries. Over the last 20 years, it is clear that FAI and JBJS(A)(B) have made prognostic studies a priority.
Only 8.5% of JOT articles were clinical prognostic, but fewer prognostic studies are expected in a trauma journal due to the acute nature of traumatic injuries as a whole. Overall, it is promising that greater than half of the articles for each journal were clinical in nature and directly focused on improving the care of patients through clinical evidence rather than mechanism-based evidence.
Citations and geographic region
JBJS(A)(B) displayed a significantly higher median number of citations/year than FAI and JOT. These results are not unique to this paper and have been seen in other studies . The higher number of citations per year for JBJS(A)(B) may be attributed to a combination of several factors. It is a well-respected and recognized orthopedic journal that publishes articles covering a broad range of topics within orthopedic surgery. Additionally, JBJS(A)(B) had an increased distribution of high LOE studies (level I and II) compared to the two subspecialty journals. Large prospective studies with higher LOE grades are often well known throughout the field and may be more commonly cited than low LOE studies like case reports and expert opinions. Nevertheless, an equal distribution of each journal was seen among the top ten most cited articles in the study. The number of times an article is cited is not a direct indicator of quality but can be used to estimate the significance and prevalence of the topic in the field. Foot and ankle trauma article citation rates were found to be equivalent or superior to rates in other orthopedic journals and subspecialties [10,13,14].
North American countries published the highest number of articles in each journal; however, all four journals showed a sizeable amount of publications from various countries throughout the world. JBJS(A)(B) had the highest percent of articles from European countries compared to FAI and JOT, and FAI had the highest percent of articles from Asian countries (9.4%). These results are consistent with a prior study looking at global publication trends from 1995 to 2015 that showed the United States as the largest producer of publications with global publishing gradually increasing . The increasing globalization of authorship speaks to the international readership and influence of the journals in this study.
Publication trends over time
In this study, a significant increase in level III and IV studies was observed from 1997 to 2017. A decrease was also seen in level V evidence studies. However, there was a decrease in the percentage of high-level studies (level I and II) over the 20-year period as well. Compared to other LOE trend studies in orthopedics, the results of this study are unique and show trends unlike several other studies that found increases in high LOE studies or decreases in level III and IV studies [3,4,6]. The trends of this study suggest a possible shift in foot and ankle trauma research from studies that draw on mechanism-based reasoning to form conclusions to large, retrospective cohort studies and case series. An example of this shift is the companion journal created by JBJS(A) for case reports, JBJS Case Connector, established in 2011. The lack of high-level evidence studies could be due to the difficultly in recruiting patients prospectively that have undergone a traumatic orthopedic emergency. There is still room for improvement with regards to high-level clinical trials in foot and ankle trauma publications, but based on the findings of this study and others in varying areas of orthopedics, it is encouraging to see that the publishing trends are going in a positive direction and emphasizing a clinical focus [2,6].
Strengths and limitations
The purpose of this study is to compare foot and ankle trauma articles between four prominent journals and analyze trends over a 20-year period of time. Although many studies of a similar nature have involved analyzing temporal trends or journal comparison, this study is able to accomplish both in a single study. Key trends and characteristics in foot and ankle trauma articles over a 20-year period were identified and will help contribute to the literature in addition to helping understand the current state of foot and ankle trauma research.
While the primary reviewers diligently searched the article archives of each journal, it is possible that suitable articles could have been missed or removed from the list of articles during the article collection process. Additionally, it was not feasible to review all foot and ankle trauma articles across multiple journals. Although each of the four journals included in the study has a high impact factor within the field of orthopedics, articles from other well-respected and notable journals that would have been a good representation of their respective field were not analyzed.
One limitation of the study is that in sampling articles in one out of every five-year interval without analyzing the intermediate years, it is possible that the data does not exactly match the trends or comparisons made during the study period. Fellowship status was classified only based on the last author and the corresponding author of each article; other coauthors that have received fellowship training may have been involved in study design. However, the training of the last or corresponding author is a suitable approximation of the vantage point of the article being published. Lastly, fellowship training was also only analyzed for articles published in the United States.
FAI and JOT are two of the leading subspecialty journals for foot and ankle and trauma publications, respectively. JBJS(A) and JBJS(B) are representative of leading general orthopedic journals, and many individuals use these journals to guide clinical practice. This study demonstrates that these journals have comparable publishing characteristics and that both the foot and ankle and trauma subspecialty journals are publishing articles with similar characteristics of those published in JBJS(A)(B).
Although these journals exhibit fairly similar publishing characteristics, it is essential that foot and ankle literature continues to progress in order to better guide clinical practice and decision making. The increase in articles assigned a LOE grade of III and IV found in this study suggest a shift in foot and ankle trauma research toward a more clinical focus; however, for the field to continue to grow the emphasis on high-quality publications needs to continue. Foot and ankle fellowship-trained authors are currently under-represented in foot and ankle trauma literature. It is important that foot and ankle specialists are well represented in the literature for a more complete understanding of the topic.
- Johnson R, Watkinson A, Mabe M: The STM Report: An Overview of Scientific and Scholarly Journal Publishing 1968-2018. International Association of Scientific, Technical and Medical Publishers, The Hague; 2018.
- Camp M, Escott BG: Authorship proliferation in the orthopaedic literature. J Bone Joint Surg Am. 2013, 95:44. 10.2106/JBJS.L.00519
- Cvetanovich GL, Fillingham YA, Harris JD, Erickson BJ, Verma NN, Bach BR: Publication and level of evidence trends in the American Journal of Sports Medicine from 1996 to 2011. Am J Sports Med. 2015, 43:220-5. 10.1177/0363546514528790
- Zaidi R, Abbassian A, Cro S, Guha A, Cullen N, Singh D, Goldberg A: Levels of evidence in foot and ankle surgery literature: progress from 2000 to 2010?. J Bone Joint Surg Am. 2012, 94:1121-10. 10.2106/JBJS.K.01453
- Ajuied A, Back D, Smith C, Davies AJ, Wong F, Earnshaw PH: Publication trends in knee surgery: a review of the last 16 years. J Arthroplasty. 2013, 28:751-8. 10.1016/j.arth.2012.12.022
- Reich MS, Shaw J, Barrett I, Goldberg VM, Schnaser E: Level of evidence trends in the Journal of Bone and Joint Surgery, 1980-2010. Iowa Orthop J. 2014, 34:197-203.
- Papatheodorou SI, Trikalinos TA, Ioannidis JP: Inflated numbers of authors over time have not been just due to increasing research complexity. J Clin Epidemiol. 2008, 61:546-51. 10.1016/j.jclinepi.2007.07.017
- Fontelo P, Liu F: A review of recent publication trends from top publishing countries. Syst Rev. 2018, 7:147. 10.1186/s13643-018-0819-1
- Mohamed NS, Gwam CU, Etcheson JI, et al.: Impact factors of orthopaedic journals between 2010 and 2016: trends and comparisons with other surgical specialties. Ann Transl Med. 2018, 6:114. 10.21037/atm.2018.03.02
- Kulkarni A V., Aziz B, Shams I, Busse JW: Comparisons of citations in Web of Science, Scopus, and Google Scholar for articles published in general medical journals. JAMA. 2009, 302:1092-6. 10.1001/jama.2009.1307
- Spindler KP, Kuhn JE, Dunn W, Matthews CE, Harrell FE, Dittus RS: Reading and reviewing the orthopaedic literature: a systematic, evidence-based medicine approach. JAMA. 2005, 10.5435/00124635-200507000-00002
- Schrock JB, Kraeutler MJ, McCarty EC: Trends in authorship characteristics in the American Journal of Sports Medicine, 1994 to 2014. Am J Sports Med. 2016, 44:1857-60. 10.1177/0363546516639955
- Yom KH, Jenkins NW, Parrish JM, et al.: Predictors of citation rate in the spine literature. Clin Spine Surg. 2020, 33:76-81. 10.1097/BSD.0000000000000921
- Bhandari M, Busse J, Devereaux PJ, et al.: Factors associated with citation rates in the orthopedic literature. Can J Surg. 2007, 50:119-23.
Publication Characteristics of Foot and Ankle Trauma Publications: A Review of Articles From 1997 to 2017
Ethics Statement and Conflict of Interest Disclosures
Human subjects: All authors have confirmed that this study did not involve human participants or tissue. Animal subjects: All authors have confirmed that this study did not involve animal subjects or tissue. Conflicts of interest: In compliance with the ICMJE uniform disclosure form, all authors declare the following: Payment/services info: All authors have declared that no financial support was received from any organization for the submitted work. Financial relationships: All authors have declared that they have no financial relationships at present or within the previous three years with any organizations that might have an interest in the submitted work. Other relationships: All authors have declared that there are no other relationships or activities that could appear to have influenced the submitted work.
Cite this article as:
Andrews N A, Alexander B, Jones J, et al. (January 10, 2021) Publication Characteristics of Foot and Ankle Trauma Publications: A Review of Articles From 1997 to 2017. Cureus 13(1): e12607. doi:10.7759/cureus.12607
Peer review began: December 30, 2020
Peer review concluded: January 06, 2021
Published: January 10, 2021
© Copyright 2021
Andrews et al. This is an open access article distributed under the terms of the Creative Commons Attribution License CC-BY 4.0., which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.