BlogCategoryTag

Header

Footer

PreFooter

ProseBlock

Blog

SocialLinks

Prose

AnnouncementContextProvider

UnnamedGlobalGroupOfVariants2

Screen

Segment

Experiment

Experiment2

scale.com (Production)

plasmic-nav

plasmic-embed-css

plasmic-basic-components

plasmic-tabs

plasmic-cms

react-chartjs-2

react-slick

react-quill

The Scale Team

Company

Artificial Intelligence (AI) and machine learning (ML) are increasingly being applied to high-stakes domains. One emergent domain involves applying ML to healthcare to assist doctors in providing better care for patients. In the United States, however, people of color face disparities in access to healthcare, the quality of care received, and overall health outcomes. In dermatology, for example, darker skin tones are underrepresented in dermatology residency programs, textbooks, research, and diagnoses. We aren’t the first researchers to investigate this problem. Academics such as <a href="https://www.mdedge.com/dermatology/article/216697/pigmentation-disorders/racial-limitations-fitzpatrick-skin-type" rel="noopener noreferrer" target="_blank">Dr. Susan Taylor</a>, <a href="https://news.mit.edu/2018/study-finds-gender-skin-type-bias-artificial-intelligence-systems-0212" rel="noopener noreferrer" target="_blank">Joy Boulamwini</a>, and <a href="https://proceedings.mlr.press/v81/buolamwini18a/buolamwini18a.pdf" rel="noopener noreferrer" target="_blank">Timnit Gebru</a> have made great strides in identifying racial limitations around critical issues such as facial recognition and healthcare. In reviewing these various papers and studies, we recognized a need for a better understanding of the underlying data fueling this research. Specifically, we sought to understand how this underrepresentation impacts an ML model’s ability to accurately diagnose various skin conditions. In collaboration with our research partner, MIT Media Lab, we analyzed and evaluated deep neural networks trained on clinical images in dermatology.<h1>Methodology:</h1> The team at Scale annotated 16,577 clinical images sourced from two dermatology atlases — DermaAmin and Atlas Dermatologico — with Fitzpatrick skin type labels. The Fitzpatrick labeling system, while not perfect, is a six-point scale originally developed for classifying sun reactivity of skin phenotype. The Fitzpatrick scale served as the basis for skin color in emojis and, more recently, the Fitzpatrick scale has been used in computer vision applications to evaluate algorithmic fairness and model accuracy. The annotated images represent 114 skin conditions with at least 53 images and a maximum of 653 images per skin condition. The annotations, which we are calling the Fitzpatrick 17k Dataset, have been open-sourced <a href="https://github.com/mattgroh/fitzpatrick17k" rel="noopener noreferrer" target="_blank">here</a> if you would like to explore the dataset in greater detail.<img src="https://imagedelivery.net/wLbZE4_NzVVdgHc15St55g/8176b7a8-94e7-494b-746f-17563912e200/public" alt="The Fitzpatrick Skin Type Scale"> After the dataset had been labeled, researchers at MIT trained a transfer learning model based on a VGG-16 deep neural network architecture pre-trained on the seminal ImageNet dataset to classify various skin conditions. For more details on how the model was trained, we encourage you to read the full paper <a href="https://arxiv.org/abs/2104.09957" rel="noopener noreferrer" target="_blank">here</a>. <h2>Research Findings:</h2> The research found that the data used to train a model does matter. By tagging the images with Fitzpatrick labels, researchers found that the dataset contains 3.6 times more images of the two lightest Fitzpatrick skin types than the two darkest Fitzpatrick skin types. The underrepresentation of dark skin images in the dataset — and in dermatology atlases more broadly — led to larger disparities in the model’s ability to correctly diagnose skin conditions involving darker skin tones. While more research is required to identify where accuracy disparities are greatest across skin types, this research empirically shows that the data a model is trained on matters. More importantly, it matters how data is collected and what type of data is collected. Before developing and deploying large-scale ML models in the healthcare sector, we encourage researchers and practitioners to consider and examine biases in training datasets to ensure healthcare disparities are not unintentionally amplified by these models.

Improving clinical dermatology diagnostics with better data

Scale AI & MIT Media Lab: Improving Clinical Dermatology Diagnostics

Scale AI and Research Partner MIT Media Lab Analyze Bias in Dermatological Datasets to Improve Diagnoses

open-dataset-nucleus

slugs must be all lowercase. ie: ‘my-slug’

events-banner

This entry represents both interview quote highlight and interview chat highlight because of Builder limitations. Choose the fields that matches either of them.

interview-highlight

If it's selected, the author and quote fields will be taken, otherwise the chat fields. The default is for chat.

resources-download-model

transform-session

CTA to open the session. Leave blank if you don't want a cta for that session

Link for the CTA. Usually the link to the exchange session

blog-filter-type

event-transform-x-ticket

solution

homepage-quotes

logos

homepage-content

builder-debug

transfrom-x-in-person

event-model

Toggle if the event is featured. Featured events will be moved to the top of the list

guides-cta

summit-2023-partners

sales

z[deprecated] page

quotes

z[deprecated] compare

product

blog-category-model

announcement-banner

accelerate

Vercel Powered and Edge Computed OG Image. Preferred over og img file upload. If this field is non empty, it will take precedent over the uploaded file

summit-2023-speakers

homepage-resources

customers

Display order on the page /customers. Higher values show first

page-cross-product-webinar

interview

event-transform

Event model for new marketing events page

event-2-0

homepage-event

custom-fonts

transform-x-speaker

Be careful to not add any trailing white spaces to the slug. Slugs must be all lowercase. ie: ‘my-slug’

Order of the featured speakers displayed on the home page for transformX

z[deprecated] document-ai

summit-2023-agenda

event-converge

hosts

author

transform-x

Page: /In-Person. Section: Hero. Text: Title Text

Page: /In-Person. Section: Slider Card. Text: Title Text

Page: /In-Person. Section: Slider Card. Text: Card Body

Page: /In-Person. Section: Hero. Text: Tagline

open-dataset

z[deprecated] customers

URL redirections for Website. Disclaimer: takes 5~ min for each added or edited.

url-redirects

Use relative path. use `/blog/foo` not `https://scale.com/blog/foo`

legal

event

Optional second image intended to show on the grid view, should be a more squared image closer to 1:1 aspect ratio than the one used in the Cover field.

guides

z[deprecated] guides-old

z[deprecated] guides-lp

partners

blog-model

Option to list or not list this post in the Blog index. Enabled = not list in the index, Disabled = list in the index

Products

Government

Solutions

Resources

Customers

Pricing →

Scale AI and Research Partner MIT Media Lab Analyze Bias in Dermatological Datasets to Improve Diagnoses

The future of your industry starts here.