
In theory, the feature works like this: when photos are sent via Messages between users who are under a certain age (13), those photos will be scanned by a machine learning algorithm. TELL APPLE: DON'T SCAN OUR PHONES How Messages Scanning Works It both opens a security hole in Messages, and ignores the reality of where abuse most often happens, how dangerous communications occur, and what young people actually want to feel safe online. But scanning and flagging Messages images will, unfortunately, create serious potential for danger to children and partners in abusive households. And it’s clear that there are no easy answers when it comes to child endangerment. And when such promises are broken, it inevitably opens the door to other harms that’s what makes breaking encryption so insidious.Īpple’s goals are laudable: protecting children from strangers who use communication tools to recruit and exploit them, and limiting the spread of child sexual abuse material. One of the plans-scanning photos sent to and from child accounts in Messages-breaks Apple’s promise to offer end-to-end encryption in messaging. This month, Apple announced several new features under the auspices of expanding its protections for young people, at least two of which seriously walk back the company’s longstanding commitment to protecting user privacy.
