Assessment of the Breast Cosmesis Using Deep Neural Networks: an Exploratory Study (ABCD)

Overview

Surgery and radiotherapy in breast cancer patients can cause treatment changes and may affect the final breast appearance. In this study, we are trying to evaluate the post treatment breast photographs of the patients and subject these to Artificial Intelligence based program so as to classify into appropriate categories based upon changes from baseline. This automated solution will help in decreasing the time required to achieve this task by physicians in the clinic.

A new algorithm was introduced which is based on deep neural network (DNN) which receives an image as input and returns the coordinates of the breast key points as output. These key points are then given to a shortest-path algorithm that models images as graphs to refine breast key point localization. The algorithm learns, directly from the image, to compute features and to use those features in the analysis of the aesthetic result. This comprises of two main modules: regression and refinement of heatmaps, and regression of key points. To perform the heatmap regression, the U-Net model is used. The goal of the first module is to generate an intermediate representation consisting on a fuzzy localization for the key points that are to be detected. The second module receives and refines this fuzzy localization, and through complex calculations, outputting the x and y coordinates of the keypoints, and the data generated from which can be used for disease / image classification.

Conditions

Eligibility

Locations (1)

Outcomes

Central Contacts