Takeaways
Question: Can the Skin Analyzer be used in clinical research to assess Fitzpatrick skin type?
Findings: This technique displayed an 80% classification accuracy for all skin types in various lighting conditions in a hospital setting. A Krippendorff alpha of 0.84 was calculated across 13 different rates, using the app to assess Fitzpatrick skin type.
Meaning: The Skin Analyzer is a new tool that allows for cost and time-efficient Fitzpatrick score calculation from digital images with high interrater reliability and accuracy than can be used in retrospective studies aiming to explore the relationship between skin color and clinical outcomes.
THE APP: THE SKIN ANALYZER
Current medical research and education lacks a robust understanding of skin color as an objective variable, making it difficult to quantify its impact as both a social and physical determinant of health.1–4 Physical colorimeters or spectrophotometers are the current gold standard to objectively quantify skin color independently from race or ethnicity.5–7 These tools, however, must be used in person with the patient present. Data collection is limited by expensive equipment, timing, transportation, and prospective planning.8 Medical records contain an entire database of patient images that can be used in retrospective studies, but current available methods do not allow for the utilization of these images to quantify skin color. At best, these photographs may be subjectively analyzed by professionals with experience in skin color identification. This method is subject to bias and can vary between providers.6,9,10 We have created a pilot digital app, Skin Analyzer, to harness objective data on skin color from the digital images in medical records, which may ultimately aid research on diverse skin tones.
A desktop app, the Skin Analyzer, was created based on the 1976 CIELAB colorspace11 and the skin type classification presented by Chardon et al.12 RGB values in a digital image are first transformed to the CIELAB color space, a device independent color space designed to more closely resemble human color perception. Rather than describing the red, green, and blue content of a color, CIELAB describes color in three axes based on light/dark (the L* axis), red/green (the a* axis), and blue/yellow (the b* axis), which correlate with skin pigmentation, erythema, and pigmentation/tanning, respectively.6 An individual typology angle can be calculated based on the L* and b* values, which may be classified into one of the six Fitzpatrick skin types.12,13
The app allows for flexible assistance in data collection and skin type categorization from digital images. (See Video [online], which displays a detailed walkthrough of how to use the app.) Briefly, on startup, the user may adjust the aperture to dictate how large an area should be sampled. In the multipoint collection mode, the user may also select how many samples (between 1 and 20) should be collected from each image (Fig. 1). With two-point collection, two color samples will be collected from each image, and an additional parameter, ΔE, is reported as a measure of how different the two locations may be to human perception. After selecting the folder containing the desired images, the app will present each image, and the user will be prompted to select points on the image to populate the samples field on the right (Fig. 1). Care should be taken to avoid areas with glare, shadows, or moles/rashes. The process will repeat until all images have been analyzed. All variables reported by Skin Analyzer and their significance are described in Tables 1 and 2.
Table 1. - Variables Collected by The Skin Analyzer
Variable | Description |
---|---|
L*, a*, and b* values | The CIELAB color space is designed to resemble human color perceptual changes more closely than RGB, and it is useful in detecting small color differences. The mean L*, a*, b* values for the selected region are reported |
RGB | The RGB color space is used to define color in digital images and is simply the original digital representation of the sample. The mean RGB values for the selected region are reported |
x and y coordinates | The x and y coordinates for the center of each region sampled are recorded to allow for the exact pixels used in the Fitzpatrick calculation to be accessed later. This may be used by other software to help identify skin or specific areas on an image without the need for another researcher to reidentify these locations |
Table 2. - Variables Calculated by The Skin Analyzer©
Variable | Description | Formula | |
---|---|---|---|
ITA angle | The individual typology angle condenses the three-dimensional CIELAB values into a single number correlating to skin color “volume,” a number that allows for objective classification of skin color for medical research | ITA degrees = | |
Fitzpatrick Skin Type | A scale developed to classify skin coloring and response to ultraviolet light. This scale is widely used to determine eligibility and dose for dermatologic treatments and its applications continue to expand | 50 degrees < ITA degrees | Skin type I |
41 degrees < ITA ≤ 50 degrees | Skin type II | ||
28 degrees < ITA ≤ 41 degrees | Skin type III | ||
10 degrees < ITA ≤ 28 degrees | Skin type IV | ||
− 30 degrees < ITA ≤ 10 degrees | Skin type V | ||
ITA ≤ − 30 degrees | Skin type VI | ||
ΔE* | A variable that represents the perceptual color difference between two points, typically on the same subject. ΔE < 1 indicates a color difference discernible by the human eye | |
To assess the effect of lighting variability on accuracy of Fitzpatrick type calculation, six known colors that correlate to the six Fitzpatrick skin types, as represented in Figure 2 adapted from Ly et al,6 were printed and photographed in 15 different locations with varying lighting around the hospital. The fifteen photographs were sampled by the app and compared with the original Fitzpatrick score. Although variable lighting led to some classification one category above or below known Fitzpatrick type of each color strip, an overall classification accuracy of 80% was maintained (Fig. 3).
To account for user variability in sample selection, interrater reliability was calculated. The data generated by 13 untrained users testing the app on photographs from six human patients was used to calculate a previously reported coefficient,14 Krippendorff alpha, which is a reliability coefficient quantifying the agreement between independent raters or judges.15 We obtained an alpha value of 0.84, indicating a high interrater reliability.
DISCUSSION
Existing research on skin color in the field of plastic surgery has shown that it can be an important factor not only in health equity but also in the prevalence of disease, patient risk for certain conditions, and patient outcomes,2,16–18 but such investigations are hindered by difficulty collecting objective and consistent data on skin color. It has been reported that plastic surgery journals use significantly more images of white-skinned than dark-skinned individuals.3 Medical texts and education have also historically lacked diversity in patient examples, which can lead to bias and, ultimately, worse patient outcomes.1 As medicine and the field of plastic surgery work to increase the diversity of research study patient samples, an accessible way to objectively measure patient skin color is needed. Although race or ethnicity information is commonly used as a measure of diversity in research studies, it does not accurately provide specific information on the skin color of patients. Patient skin color may be particularly important to plastic surgery in fields such as burns and aesthetics, as it is important to understand the skin-related risk factors, treatment, and outcomes as they relate to objective skin color. Currently, a physical colorimeter can be used in prospective studies to assess skin color, although this method is not without flaws.8 In retrospective studies, the only option to precisely identify skin color is to use experts with experience in skin color identification.6,9,10 The biggest limitation of the Skin Analyzer is the small effect of variable lighting on accurate estimates; however, this limitation is shared by experts identifying skin type from digital images. We have developed the Skin Analyzer to provide researchers with a more cost-efficient and time-efficient method of collecting objective skin color information in retrospective studies. The Skin Analyzer is open source and available for use at theskinanalyzer.com. The code can be downloaded, and we invite others to improve the app. Despite the current limitations, the Skin Analyzer is a new tool that researchers can use to explore the effects of skin color in plastic surgery treatments and outcomes. We hope this tool will promote research into furthering the understanding of skin color as a variable in medicine and that researchers will find it useful.
DISCLOSURE
The authors have no financial interest to declare in relation to the content of this article.
REFERENCES
1.Tsai J, Ucik L, Baldwin N, et al. Race matters? Examining and rethinking race portrayal in preclinical medical education. Acad Med. 2016;91:916–920.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
2.Jothishankar B, Stein SL. Impact of skin color and ethnicity. Clin Dermatol. 2019;37:418–429.
- Cited Here |
- PubMed | CrossRef |
- Google Scholar
3.Chawla S, Shihadeh H, Patel A. An analysis of racial diversity in the breast reconstruction and aesthetic surgery literature. Plast Reconstr Surg Glob Open. 2022;10:e4487.
- Cited Here |
- Google Scholar
4.Sobol DL, Cho DY, Massie JP, et al. An evaluation of racial diversity in craniofacial surgery literature. J Craniofac Surg. 2022;33:76–80.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
5.Wang M, Xiao K, Wuerger S, et al. Measuring human skin colour. Proc IS&T 23rd Color and Imaging Conf. 2015;23:230–234.
- Cited Here |
- Google Scholar
6.Ly BCK, Dyer EB, Feig JL, et al. Research techniques made simple: cutaneous colorimetry: a reliable technique for objective skin color measurement. J Invest Dermatol. 2020;140:3–12.e1.
- Cited Here |
- PubMed | CrossRef |
- Google Scholar
7.Gordon RA, Branigan AR, Khan MA, et al. Measuring skin color: consistency, comparability, and meaningfulness of rating scale scores and handheld device readings. J Surv Stat Methodol. 2022;10:337–364.
- Cited Here |
- Google Scholar
8.Treesirichod A, Chansakulporn S, Wattanapan P. Correlation between skin color evaluation by skin color scale chart and narrowband reflectance spectrophotometer. Indian J Dermatol. 2014;59:339–342.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
9.Hall WJ, Chapman MV, Lee KM, et al. Implicit racial/ethnic bias among health care professionals and its influence on health care outcomes: a systematic review. Am J Public Health. 2015;105:e60–e76.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
10.Massie JP, Cho DY, Kneib CJ, et al. It’s not just black and white: a call for skin color diversity representation in plastic surgery literature. J Craniofac Surg. 2019;30:2659.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
11.Weatherall IL, Coombs BD. Skin color measurements in terms of CIELAB color space values. J Invest Dermatol. 1992;99:468–473.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
12.Chardon A, Cretois I, Hourseau C. Skin colour typology and suntanning pathways. Int J Cosmet Sci. 1991;13:191–208.
- Cited Here |
- PubMed | CrossRef |
- Google Scholar
13.Wilkes M, Wright CY, du Plessis JL, et al. Fitzpatrick skin type, individual typology angle, and melanin index in an African population: steps toward universally applicable skin photosensitivity assessments. JAMA Dermatol. 2015;151:902–903.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
14.Hallgren KA. Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quant Methods Psychol. 2012;8:23–34.
- Cited Here |
- PubMed |
- Google Scholar
15.Krippendorff K. Computing Krippendorff’s Alpha-Reliability. 2011. Available at https://repository.upenn.edu/entities/publication/034a6030-c584-4d14-9d3d-7b7e8d16df20. Accessed September 14, 2023.
- Cited Here |
- Google Scholar
16.Oozageer Gunowa N, Hutchinson M, Brooke J, et al. Pressure injuries in people with darker skin tones: a literature review. J Clin Nurs. 2018;27:3266–3275.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
17.Perez K, Steppe C, Teotia SS, et al. Does Fitzpatrick score predict flap loss? Microsurgical breast reconstruction outcomes of varying skin color. Plast Reconstr Surg Glob Open. 2022;10:e4637.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar
18.Sarver MM, Rames JD, Ren Y, et al.; Duke Breast and Plastic Surgery Workgroup. Racial and ethnic disparities in surgical outcomes after postmastectomy breast reconstruction. J Am Coll Surg. 2022;234:760–771.
- Cited Here |
- View Full Text | PubMed | CrossRef |
- Google Scholar