Accuracy of an Artificial Intelligence-assisted Diagnostic System for Caries Diagnosis: a Prospective Multicenter Clinical Study

N/ANot Yet RecruitingNCT06428344

Zhejiang Provincial People's Hospital220 enrolled

Overview

This clinical trial was designed as a prospective, multicenter, multi-reader multi-case (MRMC), superiority, parallel-controlled study. Participants who met the trial criteria and signed the informed consent form were enrolled. The trial group involved diagnoses of caries on panoramic radiographs using an artificial intelligence-assisted diagnostic system, while the control group involved diagnoses made by dental practitioners specializing in operative dentistry and endodontics with five years of experience, who interpreted oral panoramic radiographs to determine the presence and severity of caries.

Study Type

OBSERVATIONAL

Enrollment

220

Conditions

Dental Caries Artificial Intellegence Diagnosis Machine Learning

Eligibility

Sex: ALLMin age: 18 YearsMax age: 70 Years

Medical Language ↔ Plain English

Inclusion Criteria: \- Inclusion Criteria: 1. Patients presenting with clinical manifestations of caries as their chief complaint; 2. Age ≥18 and ≤70 years, irrespective of gender; 3. Oral panoramic radiographs showing a complete dentition, specifically with the second molars and all premolars intact in each quadrant; 4. On the oral panoramic radiographs, the number of teeth with restorations or fillings does not exceed one in any quadrant; 5. Oral panoramic radiographs that are clear, easy to interpret, and free from significant artifacts; 6. Participants who voluntarily agree to partake, can comprehend the purpose of the study, and are capable of signing an informed consent form. Exclusion Criteria: 1. Oral panoramic radiographs that are unclear, with overlapping, blurring, or artifacts present; 2. Insufficient number of teeth available for study; 3. Severe tooth wear or erosion leading to significant alteration in tooth morphology; 4. Presence of supernumerary teeth, microdontia, or missing teeth; 5. Conditions not suitable for oral radiography, such as pregnancy or undergoing radiation therapy for tumors; 6. Limited mouth opening that precludes clinical examination; 7. Neurological disorders, psychiatric illnesses, or psychological impairments; 8. Participation in another clinical trial within the last three months; 9. Any other condition deemed by the researchers as unsuitable for inclusion in the study.

Outcomes

Primary Outcomes

Sensitivity, specificity, and accuracy of caries diagnosis

Sensitivity: Sensitivity assesses the diagnostic method's ability to identify the disease, that is, how many true cases of caries can be correctly identified among all actual cases of caries. Specificity: Specificity evaluates the diagnostic tool's ability to recognize the absence of disease, meaning how many true non-caries cases can be correctly identified among all actual non-caries cases. Accuracy: Accuracy evaluates the overall correctness of the diagnostic tool in diagnosing the disease.

Time frame: Immediately after the completion of all participant information collection.

Secondary Outcomes

Miss rate and false positive rate of caries diagnosis

Miss rate (False Negative Rate): The miss rate refers to the proportion of true caries cases that the diagnostic method fails to correctly identify among all actual cases of caries. In this study, the effectiveness of the artificial intelligence-assisted diagnostic system is evaluated by comparing the miss rate of caries diagnosis between the artificial intelligence-assisted diagnostic system and dentists with five years of experience. False positive rate: The false positive rate refers to the proportion of cases that are incorrectly identified as having caries among all actual non-caries cases. In this study, the effectiveness of the artificial intelligence-assisted diagnostic system is evaluated by comparing the false positive rate of caries diagnosis between the artificial intelligence-assisted diagnostic system and dentists with five years of experience.

Time frame: Immediately after the completion of all participant information collection.

Accuracy of Caries Severity Level Diagnosis

This study utilizes the International Caries Detection and Assessment System (ICDAS) to evaluate the grading of caries severity, categorizing caries severity into five levels: E0, E1, E2, D1, and D2. Wherein: E0 indicates no apparent signs of caries; E1 represents early caries, primarily initial enamel lesions; E2 designates enamel caries without involvement of the dentin; D1 denotes superficial dentin caries, not reaching half of the dentin thickness; D2 signifies deep dentin caries, reaching or exceeding half of the dentin thickness. This study will assess and compare the diagnostic accuracy at each grading level between the trial group and the control group.

Time frame: Immediately after the completion of all participant information collection.