Medium had been reporting a mismatch between actual followers and displayed followers for a couple of weeks from when I first noticed it. I thought the notice was displayed on the Audience stats page. Mine dropped in the displayed amount now aligns with the audience stats page. So I think it was just a counting error not any actual loss of followers.