The actor believes many remain quiet because they're scared they'll suffer the same fate as the oppressed