Even as a non-native speaker there's no question this privileges some of us. It seems there's a pretty easy check: Would you consider it a barrier if you had to write your next paper in Mandarin or Spanish? Both have more native speakers than English.
Are native English speakers privileged in academia?