DENTEX CHALLENGE 2023

Dental Enumeration and Diagnosis on Panoramic X-rays¶

METRICS for ASSESSMENT¶

In order to evaluate the performance of the participating teams, the DENTEX Challenge utilizes a comprehensive set of metrics, including AP50, AP75, AP, and AR. These performance evaluation metrics are calculated based on a fully annotated testing dataset that encompasses quadrant-enumeration-diagnosis data for the quadrant, enumeration, and diagnosis aspects of dental image analysis. This results in a total of 12 metrics that are employed for evaluating the performance of the participating teams.

For the final leaderboard, we employ a mean rank aggregation approach. Each team is ranked from 1 to n (n, the number of teams) for every metric within each subtask (e.g., AR for Quadrant Detection), with 1 assigned to the highest-performing team. This produces 12 ranks per team across all metrics (AP, AP50, AP75, and AR for the three subtasks). The mean of these 12 ranks is then computed for each team, and the teams are sorted in ascending order of their mean ranks to determine the final DENTEX Challenge standings.

The final top three ranked participating teams, according to their evaluation against the testing data, will be invited to MICCAI 2023 for a presentation of their methods and results and to receive their monetary awards.