Do all runners on base advance when a free base penalty is applied?

No, runners on base only advance if forced forward by the process of the kicker advancing to first base.