“A man in his early 30s was chatting about sex with a 13-year-old South Florida girl and planned to meet her after middle-school classes the next day. Facebook’s extensive but little-discussed technology for scanning postings and chats for criminal activity automatically flagged the conversation for employees, who read it and quickly called police. Officers took control of the teenager’s computer and arrested the man the next day.”
As the officer explained, Facebook looks for a few red flags such as if the two users only recently became friends, having no mutual friends but a large age difference. Certain key words that have been culled as typically used by sexual predators are also being looked for.
“We’ve never wanted to set up an environment where we have employees looking at private communications, so it’s really important that we use technology that has a very low false-positive rate,” said Sullivan. The company has already been criticized for selling key terms in user posts to advertisers.
Whether such security measures are limited only to sexual predators — which is usually just the front door to internet monitoring and privacy invasion — is not certain. Facebook has of course cooperated with a murder case, sending over 62 pages of photos, wall posts, messages, and contacts. This bit of monitoring itself was only recently exposed, and there is no indication as to what else they are looking at.