What could go wrong?

The latest puff piece in Tech Crunch profiling the apparently innocuous sounding "roll out" of AI (as if a mere modest software update) "to detect suicidal posts before they're reported" opens with the glowingly optimistic line, "This is software to save lives" - so who could possibly doubt such a wonderful and benign initiative which involves AI evaluating people's mental health? Tech Crunch's Josh Cronstine begins:

This is software to save lives. Facebook's new "proactive detection" artificial intelligence technology will scan all posts for patterns of suicidal thoughts, and when necessary send mental health resources to the user at risk or their friends, or contact local first-responders. By using AI to flag worrisome posts to human moderators instead of waiting for user reports, Facebook can decrease how long it takes to send help.