Urologist validation of an artificial intelligence-based tool for automated estimation of penile curvature

Abstract

Introduction Severity of penile curvature (PC) is commonly used to select the optimal surgical intervention for hypospadias, either alone or in conjunction with other phenotypic characteristics. Despite this, current literature on the accuracy and precision of different PC measurement techniques in hypospadias patients remains limited. Purpose Assess the feasibility and validity of an artificial intelligence (AI)-based model for automatic measurement of PC. Material and methods Seven 3D-printed penile models with variable degrees of ventral PC were used to evaluate and compare interobserver agreement in estimation of penile curvatures using various measurement techniques (including visual inspection, goniometer, manual estimation via a mobile application, and an AI-based angle estimation app. In addition, each participant was required to complete a questionnaire about their background and experience. Results Thirty-five clinical practitioners participated in the study, including pediatric urologists, pediatric surgeons, and urologists. For each PC assessment method, time required, mean absolute error (MAE), and inter-rater agreement were assessed. For goniometer-based measurement, the lowest MAE achieved was derived from a model featuring 86° PC. When using either UVI (unaid visual inspection), mobile apps, or AI-based measurement, MAE was lowest when assessing a model with 88° PC, indicating that high-grade cases can be quantified more reliably. Indeed, MAE was highest when PC angle ranged between 40° and 58° for all the investigated measurement tools. In fact, among these methodologies, AI-based assessment achieved the lowest MAE and highest level of inter-class correlation, with an average measurement time of only 22 s. Conclusion AI-based PC measurement models are more practical and consistent than the alternative curvature assessment tools already available. The AI method described in this study could help surgeons and hypospadiology researchers to measure PC more accurately.