The Non Followers list syncs once every thirty minutes. Hold on a little longer, and you’ll definitely see the right results.