That's very common. You can use a pumace stone to help reduce the roughness. We keep one in the tub for that purpose.
""Pumice stones" are often used in beauty salons during the pedicure process to remove dry and excess skin from the bottom of the foot as well as calluses. It was also used in ancient Greek and Roman times to remove excess hair. Finely ground pumice is added to some toothpastes and heavy-duty hand cleaners (such as Lava soap) as a mild abrasive. Pumice is also used as a growing substrate for growing horticultural crops" Wikipedia