Apple’s AI-Powered Image Playground App Reportedly Has Bias Issues

Apple’s Image Playground app is claimed to have some bias points. A machine studying scientist lately shared a number of outputs generated utilizing the synthetic intelligence (AI) app and claimed that it contained incorrect pores and skin tone and hair texture on a number of events. These inaccuracies had been additionally stated to be paired with particular racial stereotypes, including to the issue. It is tough to state whether or not the alleged challenge is a one-off incident or a widespread challenge. Notably, the Cupertino-based tech large first launched the app as part of Apple Intelligence go well with with the iOS 18.2 replace.

Apple’s Image Playground App Might Have Bias Issues

Jochem Gietema, the Machine Learning Science Lead at Onfido, shared a weblog publish, highlighting his experiences utilizing Apple’s Image Playground app. In the publish, he shared a number of units of outputs generated utilizing the Image Playground app and highlighted the situations of racial biases by the big language mannequin powering the app. Notably, Gadgets 360 employees members didn’t discover any such biases whereas testing out the app.

“While experimenting, I noticed that the app altered my skin tone and hair depending on the prompt. Professions like investment banker vs. farmer produce images with very different skin tones. The same goes for skiing vs. basketball, streetwear vs. suit, and, most problematically, affluent vs. poor,” Gietema stated in a LinkedIn publish.

Alleged biased outputs generated utilizing the Image Playground app
Photo Credit: Jochem Gietema

Such inaccuracies and biases aren’t uncommon with LLMs, that are educated on massive datasets which could comprise related stereotypes. Last yr, Google’s Gemini AI mannequin confronted backlash for related biases. However, corporations aren’t utterly helpless to forestall such generations and infrequently implement numerous layers of safety to forestall them.

Apple’s Image Playground app additionally comes with sure restrictions to forestall points related to AI-generated pictures. For occasion, the Apple Intelligence app solely helps cartoon and illustration types to keep away from situations of deepfakes. Additionally, the generated pictures are additionally generated with a slender field of regard which often solely captures the face together with a small quantity of extra particulars. This can also be performed to restrict any such situations of biases and inaccuracies.

The tech large additionally doesn’t permit any prompts that comprise detrimental phrases, names of celebrities or public figures, and extra to restrict customers abusing the instrument for unintended use instances. However, if the allegations are true, the iPhone maker might want to embrace extra layers of security to make sure customers don’t really feel discriminated in opposition to whereas utilizing the app.