Simon notices that Philip has greater power than him.1 Certainly the miracles which Philip did were of a more permanent and helpful nature than those which Simon performed. Likely he follows Philip at this point in order to learn from him and see if he can have access to the same power.
13 Even Simon himself believed, and after being baptized he continued with Philip. And seeing signs and great miracles performed, he was amazed.