Logo-joddd
J Dent Res Dent Clin Dent Prospects. 16(3):140-146. doi: 10.34172/joddd.2022.024

Review Article

Clinicopathological and prognostic value of Ki-67 expression in oral malignant melanoma: A systematic review and meta-analysis

Mohammad Hossein Moltajaei 1ORCID logo, Solmaz Pourzare Mehrbani 2, Paria Motahari 2, *ORCID logo, Ramin Rezapour 3
1Dental Student, Faculty of Dentistry, Tabriz University of Medical Sciences, Tabriz, Iran
2Department of Oral Medicine, Faculty of Dentistry, Tabriz University of Medical Sciences, Tabriz, Iran
3Tabriz Health Services Management Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
*Corresponding author: Paria Motahari, Email: Paria.motahari@yahoo.com

Abstract

Background. Ki-67 is one of the new biological markers with clinical value in the pathology and prognosis of oral melanoma. It is a nuclear protein involved in regulating cell proliferation. Some studies have suggested an association between Ki-67 and poor survival in patients with oral melanoma. This systematic review was undertaken to clarify this issue.

Methods. Databases of PubMed, Scopus, and Web of Science were searched using relevant English keywords from 1988 to April 2022. STATA software version 16 and random models were used for meta-analysis.

Results. Eleven articles were included in this systematic review, six of which were selected for meta-analysis. The mean expression of the Ki-67 index in patients with oral melanoma was estimated at 43.81% (28.66‒58.95 with 95% CI, I2=94.2, P<0.001). In addition, the results showed a significant relationship between Ki-67 expression and the prognosis of oral melanoma lesions. Increased expression of this marker weakens the prognosis and decreases the survival rate.

Conclusion. High expression of Ki-67 may serve as a predictive biomarker for poor prognosis in patients with malignant oral melanoma. Therefore, classifying this malignancy by Ki-67 expression may be considered for therapy regimen selection and integrated management.

Keywords: Ki-67, Meta-analysis, Oral malignant melanoma, Prognosis

Copyright

©2022 The Author(s).
This is an open-access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium provided the original work is properly cited.


Introduction

Melanoma is a neoplasm with various histological characteristics that accounts for 3% of all malignant tumors in the body.1 This tumor originates from melanocytes in the skin and oral epithelium.2 It is uncommon on the skin but has the poorest prognosis of oral malignancies and accounts for 0.2‒0.8% of all melanoma cases.3 The cause of cutaneous melanoma is sunlight; however, the cause of oral melanoma and the exact process of its formation is unknown.4 Oral malignant melanoma (OMM) is more invasive than skin cancers and is more likely to spread to other regions of the body and relapse after treatment.5 Its survival rate has been reported to be 15‒20%, compared to 67‒77% for skin types on the head and neck.6-8 A pigmented swelling is the earliest symptom of oral melanoma. An early phase exists in this form of melanoma. The radial development phase is followed by the invasion of the underlying layers, referred to as the “deep growth phase.”9

The rate of a tumor’s proliferative activity is connected to its aggressiveness and metastatic potential. Ki-67 is a proliferative marker present in cell growth or cell division during the G1, S, G2, and M stages of the cell cycle, and its increased expression in cells implies a surge in cell proliferation.10 In previous research on various malignancies of the body, particularly breast11-13 and uterine cancers,14 this component has been discovered as a factor in determining the prognosis of the lesion. In some studies, Ki-67 has been used as a diagnostic factor for melanoma and benign nevi.15 Ki-67 has been studied as a factor in determining prognosis in various subtypes of melanoma in recent years.16-19 There are differing opinions in studies on the relationship between Ki-67 expression and melanoma prognosis. Some studies have reported a direct relationship between Ki-67 expression and the progression of oral melanoma, higher disease rates, and increased mortality.10 Other studies have associated Ki-67 expression with melanoma thickness.20 Väisänen et al16 found a significant relationship between Ki-67 expression and tumor thickness. Henrique et al21 reported that the Ki-67 index was positively correlated with tumor thickness and degree of tumor malignancy and poorly correlated with overall survival rate. Some of these tumors, known as the depigmented type, do not release melanin clinically or microscopically.22 The absence of melanin pigment release in the skin type of melanoma implies that it is aggressive.23 The amelanotic nature of the lesion in the oral type has not been well examined. Soares et al24 reported that elevated Ki-67 levels in non-pigmented melanomas also suggested a more aggressive condition.

Based on the previous research discussed above, there is no consensus on the potential function of Ki-67 factor expression in different stages of oral melanoma for early diagnosis and prognosis. No systematic review is available on the association between Ki-67 expression and early detection and prognosis of oral melanoma. Therefore, we decided to plan a systematic review in this regard.


Methods

This systematic review and meta-analysis was conducted based on PICO (patient, intervention, comparison, and outcome) criteria in 2022. The following were the PICO items: patients with oral melanoma (P), Ki-67 expression gene (I), healthy people (C), oral melanoma diagnosis, and prognosis (O). The study design followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines.25

Literature search

Primarily, keywords were obtained from (MeSH) and initial literature reviews and were finalized through a pilot search. The search was conducted until April 2022.

PubMed, Scopus, EMBASE, Cochrane Library, and Web of Science databases were searched using keywords (oral melanomas, mucosal melanoma, pigmented nodular melanoma, nonpigmented nodular melanoma, pigmented macular melanoma, pigmented mixed melanoma, nonpigmented mixed melanoma, primary oral melanoma, oral melanotic lesion, melanotic neoplasm, malignant melanoma, amelanotic oral melanoma, conventional oral melanoma, mucosal melanoma, Ki-67, Ki-67 proliferation index) connected with OR and AND. Furthermore, the references of the included articles were reviewed in addition to a manual search of similar journals to boost the search.

Screening and data extraction

The Endnote X9 software was used to organize and screen obtained studies. Duplicates were eliminated first, and then the articles were screened by looking at their titles to eliminate those that were not relevant. The abstracts were reviewed, and some articles were excluded because they did not report oral or mucosal melanomas. The remaining full texts were studied, and final articles were included based on inclusion criteria. The screening process was carried out independently by two authors (MM and RR), and disagreements were solved by the third one (PM). The data from the included studies were extracted using an extraction table. The content of the extracted data was the name of the author/s, study design, sample size, age, Ki-67 expression, and results.

Inclusion criteria

  • Studies published up to April 2022

  • Articles published in English

  • Articles consistent with the objectives of the study

Exclusion criteria

  • Studies on animal specimens

  • Low-quality articles (by completing quality checklists based on scoring)

Critical appraisal of included articles

Critical appraisal was carried out for included articles in the meta-analysis. The studies reporting quality were independently assessed by two investigators (MM and RR) according to the 22-item STROBE checklist.26,27 This checklist has 22 questions. Four items related to case-control and cohort studies were deleted due to the cross-sectional nature of most papers reviewed, and the remaining 18 questions were evaluated. Checklists had a minimum score of 0 and a maximum value of 36. Good [25‒36] quality studies, medium [13‒24] quality studies, and low [0‒12] quality studies were classified.

Data analysis

The qualitative data were analyzed using content analysis. This method is commonly used in the analysis of text data.

Meta-analytical statistical methods were used to estimate the variables of the Ki-67 index rate. The meta-analysis was carried out using STATA software version 16. The results were presented using forest plot diagrams. The heterogeneity of the study results was assessed using Q and I2. The Higgins et al28 thresholds were used to evaluate the I2 (25% for low heterogeneity, 50% for medium, and 75% for high heterogeneity). The random model was selected due to the high heterogeneity of the research. In addition, subgroup analyses based on data sources (patient document review/laboratory sample) were carried out. Finally, the funnel plot diagram and Begg’s regression test were used to quantify publication bias at a significance level of 0.01.


Results

Totally 905 articles were retrieved in the literature search process. After removing duplicates, articles were screened based on title and abstract. About 132 articles were reviewed for eligibility, and 11 articles were included (Table 1), of which 6 articles were meta-analyzed. The study screening and selection process are reported in the PRISMA flow diagram ().

Table 1. Detail information about included studies that investigated the effect of the Ki-67 index in the diagnosis of oral melanoma
Authors, Years Study Design Sample Size Age (y) Ki-67 expression (%) Overall survival (months) Results
Soares et al,24
2020
Patient record review751.5Amelanotic:
64 (34‒92)
--
2258Melanotic
30.8 (11‒59)
Rodrigues et al,4 2021Patient record review75870 (n = 5)
90 (n = 2)
--
Rivera et al,29 2007Patient record review19---Ki-67 was widely expressed by melanoma cells
Perri et al,30 2017Patient record review2054--the proliferation marker Ki-67 was higher in patients with poor outcomes, and all the patients surviving at 24 months had a low expression of this marker
Ma et al,31 2017Patient record review12354n = 27 → (<5)1.59 - There were more Ki-67-positive cells in nodular lesions than in macular lesions (P<0.001).
- Ki-67 expression was associated with tumor type in OMM.
- The expression of Ki-67 in recurrent OMM was significantly higher than in primary OMM (P = 0.03).
- Cases with high Ki-67 expression had significantly poorer overall survival.
- Ki-67 expression was an independent prognostic factor for poor overall survival
- OMM patients with higher Ki-67 showed poor survival time in comparison to those with lower Ki-67
n = 19→ (5-10)2.59
n = 26→ (10-20)3.50
n = 14 → (20-30)4.38
n = 24 → (30-40)5.38
n = 13→ (>50)6.37
Korabiowska et al,32 2005Patient record review6 without metastases6718 (4‒29)-The Ki-67 index expression differed significantly between melanomas with and without metastases (P<0.05)
11 with metastases47 (8‒79)
12 with metastases lymph nodes and organs68.6 (12‒95)
de-Andrade et al,33 2012Laboratory sample225823.7 (15.51‒63)--
de-Andrade et al,3 2013Laboratory sample1123-8642.5 (15.5‒65) -
Buery et al,34 2010Patient record review1958 >80 - Ki-67 was only detected at the epithelial basal layer in oral MM (oral melanotic
macule) and was completely negative in nevus cells.
- No gender predilection was observed.
Alaeddini and Etemad-Moghadam,1 2014Patient record review195922.09 ± 15.88 -
Zhu et al35 2015Patient record review9- ≥ 30 (n = 5)
 <30 (n = 4)
Patients with anorectal melanoma had less survival time than patients with an oral cavity (P = 0.025)
joddd-16-140-g001
Figure 1. Searching an1d screening process

Meta-analysis was run based on data from 307 individuals. Most of the included studies (11 studies) were published until April 2022. Detailed information about included studies is presented in Table 1.

Ki-67 index rate

Ki-67 index in patients with oral melanoma was reported by 6 studies (). This index was estimated at 43.81 (28.66–58.95 with 95% CI, I2 = 94.2). The results revealed a high level of heterogeneity among study results. Moreover, publication bias test results showed that the probability of publication bias in the results was 0.016 (Publication Bias-Begg’s test, P = 0.016).

joddd-16-140-g002
Figure 2. Ki-67 index rate in patients with oral melanoma

Ki-67 index rate based on subgroups

A meta-analysis of the difference between the patient record review and laboratory sample studies was performed based on data source subgroups (). Four studies estimated ki-67 based on patients’ records and two studies based on laboratory samples. The index inpatient record review was estimated at 48.21 (28.49–67.93 with 95 CI, I2 = 94.94) and laboratory sample studies at 33.07 (14.69‒51.46 with 95 CI, I2 = 87.41). The results revealed no significant difference between the two groups (P = 0.27).

joddd-16-140-g003
Figure 3. Ki-67 index rate in patients with oral melanoma based on subgroups

Quality appraisal results

The average overall quality of reporting in the articles was 31.6 (rang = 0-36). The reporting quality of included articles was estimated as a good category, generally.

Effect of Ki-67 index expression on the prognosis of oral melanoma

Studies have shown that the marker Ki-67 is widely expressed in melanoma cells. Some studies have shown that in oral melanotic macule lesions, this marker is expressed only in the epithelial basal layer and is not expressed in nevus cells. There was no difference in expression between men and women. Also, the studies extracted in this study showed a significant effect between increasing the expression of this marker and decreasing the prognosis of oral melanoma.

Ki-67-positive cells were reported in nodular lesions more than macular lesions. Ki-67 expression is associated with the type of malignant oral melanoma tumor. For example, the expression of Ki-67 in recurrent OMM was significantly higher than that in primary OMM. As a result, OMM patients with higher Ki-67 had a shorter survival time than those with lower Ki-67.


Discussion

This systematic review and meta-analysis was performed to estimate the Ki-67 index in patients with oral melanoma based on 11 studies on 307 patients. Ki-67 index in patients with oral melanoma was estimated at 43.81 (28.66–58.95 with 95% CI, I2 = 94.2). Subgroup meta-analysis results showed that the Ki-67 index rates in patient record review and laboratory sample studies were 48.21 (28.49–67.93 with 95% CI, I2 = 94.94) and 33.07 (14.69–51.46 with 95% CI, I2 = 87.41), respectively. The extracted studies also showed a significant relationship between the expression of the Ki-67 marker and the prognosis of oral melanoma. Patients with metastases to lymph nodes and other body organs showed higher expression of this marker. The survival rate of these patients was significantly lower, and they had a poor prognosis.

Some studies showed that Ki-67 expression was an independent prognostic factor for poor overall survival.31 Some other studies have shown that the expression of Ki-67 also increases with metastasis to different body organs. Patients without metastasis had an average Ki-67 index rate of 18. In contrast, those with metastases to lymph nodes and other organs had an average Ki-67 index rate of 68.6.32 Ki-67-positive cells were more common in nodular lesions than macular lesions in nodular melanoma.31 Ki-67 expression was significantly higher in recurrent oral mucosal melanoma than in the primary.31

The meta-analysis showed higher Ki-67 factor levels in patient record studies than in laboratory sample research. The overall meta-analysis result for the Ki-67 index rate was 43.81 (28.66‒58.95 with 95% CI, I2 = 94.2). According to a study on cutaneous melanoma, tumors that expressed more Ki-67 (more than 10%) were thicker than tumors that expressed lower levels of this marker.17 Another study comparing the expression of this marker in patients with and without metastasis showed that in patients with oral melanoma with metastasis to various body organs, the average Ki-67 marker was 68%, which is about 60% higher than in patients without metastasis.

Based on the inclusion and exclusion criteria, we finally selected 11 articles, 6 of which were chosen for meta-analysis. However, 5 studies could not be included in the meta-analysis. Some of them, for example, did not have any quantitative data that could be used to calculate the Ki-67 marker expression index,29,30 and in others, some quantitative data were reported based on cut-off point values.31,35 Also, some studies have shown the Ki-67 marker expression without mentioning their means.33,34 In some studies, the sample size was not classified based on metastasis. However, one study divided its sample size into metastatic and non-metastatic sections32; therefore, we calculated the weighted mean to be able to include that study in the meta-analysis.

The expression level of the Ki-67 marker in oral melanoma is an effective factor in determining the prognosis of this disease. According to this systematic review, individuals with oral melanoma with higher expression of this marker have a lower survival rate. There was also a significant relationship between this marker and the spread of metastasis to other body organs.32

According to several long-term follow-up studies, the Ki-67 marker could be used to classify some cancer patients, including those with breast cancer.13,36 In addition, several studies have shown an association between Ki-67 expression and the thickness of cutaneous melanoma lesions, as well as a relationship between Ki-67 expression and the tumor’s long-term prognosis.19 However, the effect of this marker on the long-term prognosis of mucosal melanoma requires further studies.

Unfortunately, since quantitative data for prognosis was not collected, a meta-analysis of this factor was not possible. As a result, the impact of this factor on the prognosis of lesions cannot be quantified. To collect accurate quantitative data on the effect of the Ki-67 marker on the prognosis of oral melanoma, further research should be conducted to examine the Ki-67 index and the survival of these patients. Further research is necessary to determine the Ki-67 index expression threshold for lesion metastasis. In addition, staging the Ki-67 index expression level to evaluate the prognosis of the lesion can be a useful in determining the prognosis of oral melanoma lesions and developing an effective treatment plan for this illness.


Conclusion

The expression of the Ki-67 factor is higher in individuals with oral melanoma than in healthy people. As this marker’s expression rises, so will the spread of metastasis to other organs of the body, and as metastasis increases, so will the disease severity. Therefore, this marker can be effective in the diagnosis and prognosis of oral melanoma.


Author Contributions

MM and PM were mainly responsible for the design and supervision of the study. MM and SP were involved in the article screening. RR performed the meta-analysis. MM, PM and RR prepared the manuscript, and all the authors revised and approved it.


Funding

This study has no funding source.


Ethics Approval

This study was part of an approved study by the Research Ethics Committee of the Tabriz University of Medical Sciences (No: IR.TBZMED.REC.1401.074).


Competing Interests

There are no conflicts of interest relevant to this article.


References

  1. Immunohistochemical profile of oral mucosal and head and neck cutaneous melanoma. J Oral Pathol Med 2015; 44(3):234-8. doi: 10.1111/jop.12235 [Crossref]
  2. Epidemiological features and prognostic factors of cutaneous head and neck melanoma: a population-based study. Arch Otolaryngol Head Neck Surg 2007; 133(5):442-7. doi: 10.1001/archotol.133.5.442 [Crossref]
  3. Expression of minichromosome maintenance 2, Ki-67, and geminin in oral nevi and melanoma. Ann Diagn Pathol 2013; 17(1):32-6. doi: 10.1016/j.anndiagpath.2012.05.001 [Crossref]
  4. Primary melanoma of the oral cavity: a multi-institutional retrospective analysis in Brazil. Med Oral Patol Oral Cir Bucal 2021; 26(3):e379-e86. doi: 10.4317/medoral.24240 [Crossref]
  5. Oral malignant melanoma: a review of the literature. Oral Oncol 2007; 43(2):116-21. doi: 10.1016/j.oraloncology.2006.04.001 [Crossref]
  6. Oral mucosal melanoma: epidemiology and pathobiology. Oral Oncol 2000; 36(2):152-69. doi: 10.1016/s1368-8375(99)00085-8 [Crossref]
  7. Head and neck cutaneous melanoma: a retrospective observational study on 146 patients. Acta Oncol 2009; 48(3):460-7. doi: 10.1080/02841860802404356 [Crossref]
  8. Experience with 998 cutaneous melanomas of the head and neck over 30 years. Am J Surg 1991; 162(4):310-4. doi: 10.1016/0002-9610(91)90138-4 [Crossref]
  9. Oral malignant melanoma in Japan. Oral Surg Oral Med Oral Pathol 1994; 78(1):81-90. doi: 10.1016/0030-4220(94)90121-x [Crossref]
  10. The expression of MMP-2 and Ki-67 in head and neck melanoma, and their correlation with clinic-pathologic indices. J Cancer Res Ther 2014; 10(3):696-700. doi: 10.4103/0973-1482.138122 [Crossref]
  11. Assessment of Ki67 in breast cancer: recommendations from the International Ki67 in breast cancer working group. J Natl Cancer Inst 2011; 103(22):1656-64. doi: 10.1093/jnci/djr393 [Crossref]
  12. Optimal Ki67 cut-off for luminal breast cancer prognostic evaluation: a large case series study with a long-term follow-up. Breast Cancer Res Treat 2016; 157(2):363-71. doi: 10.1007/s10549-016-3817-9 [Crossref]
  13. Ki67 expression in breast cancer. Correlation with prognostic markers and clinicopathological parameters in Saudi patients. Saudi Med J 2016; 37(2):137-41. doi: 10.15537/smj.2016.2.12285 [Crossref]
  14. Screening for cervical cancer precursors with p16/Ki-67 dual-stained cytology: results of the PALMS study. J Natl Cancer Inst 2013; 105(20):1550-7. doi: 10.1093/jnci/djt235 [Crossref]
  15. Automated quantification of Ki67/MART1 stains may prevent false-negative melanoma diagnoses. J Cutan Pathol 2016; 43(11):956-62. doi: 10.1111/cup.12778 [Crossref]
  16. A prognostic index in skin melanoma through the combination of matrix metalloproteinase-2, Ki67, and p53. Hum Pathol 2011; 42(8):1103-11. doi: 10.1016/j.humpath.2010.11.013 [Crossref]
  17. Proliferation indices of phosphohistone H3 and Ki67: strong prognostic markers in a consecutive cohort with stage I/II melanoma. Mod Pathol 2013; 26(3):404-13. doi: 10.1038/modpathol.2012.188 [Crossref]
  18. Ki67 antigen and PCNA proliferation markers predict survival in anorectal malignant melanoma. Histopathology 2002; 41(6):519-25. doi: 10.1046/j.1365-2559.2002.01444.x [Crossref]
  19. Ki67 antigen as a predictive factor for prognosis of sinonasal mucosal melanoma. Clin Exp Otorhinolaryngol 2008; 1(4):206-10. doi: 10.3342/ceo.2008.1.4.206 [Crossref]
  20. Correlation of Ki-67 expression in cutaneous primary melanoma with prognosis in a prospective study: different correlation according to thickness. J Am Acad Dermatol 2001; 44(2):188-92. doi: 10.1067/mjd.2001.110067 [Crossref]
  21. Prognostic value of Ki-67 expression in localized cutaneous malignant melanoma. J Am Acad Dermatol 2000; 43(6):991-1000. doi: 10.1067/mjd.2000.109282 [Crossref]
  22. Malignant melanoma clinically mimicking pyogenic granuloma: comparison of clinical evaluation and histopathology. Melanoma Res 2018; 28(4):363-7. doi: 10.1097/cmr.0000000000000451 [Crossref]
  23. Amelanotic melanoma: a detailed morphologic analysis with clinicopathologic correlation of 75 cases. J Cutan Pathol 2012; 39(1):33-9. doi: 10.1111/j.1600-0560.2011.01808.x [Crossref]
  24. Comparative expression of cyclooxygenase 2 and Ki67 in amelanotic and conventional oral melanomas. Med Oral Patol Oral Cir Bucal 2020; 25(6):e728-e31. doi: 10.4317/medoral.23737 [Crossref]
  25. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ 2021; 372:n71. doi: 10.1136/bmj.n71 [Crossref]
  26. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: Guidelines for Reporting Observational Studies. Ann Intern Med 2007; 147(8):573-7. doi: 10.7326/0003-4819-147-8-200710160-00010%m17938396. [Crossref]
  27. The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) Statement: guidelines for reporting observational studies. Int J Surg 2014; 12(12):1495-9. doi: 10.1016/j.ijsu.2014.07.013 [Crossref]
  28. Measuring inconsistency in meta-analyses. BMJ 2003; 327(7414):557-560. doi: 10.1136/bmj.327.7414.557 [Crossref]
  29. Heparanase and vascular endothelial growth factor expression in the progression of oral mucosal melanoma. Oncol Rep 2008; 19(3):657-61.
  30. Optimal multidisciplinary treatment of oral cavity mucosal melanoma: outcome analysis in a case series. Anticancer Drugs 2017; 28(3):327-34. doi: 10.1097/cad.0000000000000454 [Crossref]
  31. Ki67 proliferation index as a histopathological predictive and prognostic parameter of oral mucosal melanoma in patients without distant metastases. J Cancer 2017; 8(18):3828-37. doi: 10.7150/jca.20935 [Crossref]
  32. Relationship of nm23 expression to proliferation and prognosis in malignant melanomas of the oral cavity. In Vivo 2005; 19(6):1093-6.
  33. Primary oral melanoma: a histopathological and immunohistochemical study of 22 cases of Latin America. Med Oral Patol Oral Cir Bucal 2012; 17(3):e383-8. doi: 10.4317/medoral.17588 [Crossref]
  34. Clinico-pathological evaluation of oral melanotic macule, oral pigmented nevus and oral mucosal melanoma. J Hard Tissue Biol 2010; 19(1):57-64. doi: 10.2485/jhtb.19.57 [Crossref]
  35. Clinicopathologic features and prognostic factors in patients with non-cutaneous malignant melanoma: a single-center retrospective study of 71 cases. Int J Dermatol 2015; 54(12):1390-5. doi: 10.1111/ijd.12745 [Crossref]
  36. MIB1/Ki-67 labelling index can classify grade 2 breast cancer into two clinically distinct subgroups. Breast Cancer Res Treat 2011; 127(3):591-9. doi: 10.1007/s10549-010-1028-3 [Crossref]
Submitted: 10 Apr 2022
Revised: 19 Jun 2022
Accepted: 18 Jul 2022
First published online: 15 Nov 2022
EndNote EndNote

(Enw Format - Win & Mac)

BibTeX BibTeX

(Bib Format - Win & Mac)

Bookends Bookends

(Ris Format - Mac only)

EasyBib EasyBib

(Ris Format - Win & Mac)

Medlars Medlars

(Txt Format - Win & Mac)

Mendeley Web Mendeley Web
Mendeley Mendeley

(Ris Format - Win & Mac)

Papers Papers

(Ris Format - Win & Mac)

ProCite ProCite

(Ris Format - Win & Mac)

Reference Manager Reference Manager

(Ris Format - Win only)

Refworks Refworks

(Refworks Format - Win & Mac)

Zotero Zotero

(Ris Format - FireFox Plugin)

Abstract View: 567
PDF Download: 255
Full Text View: 62