All perfect praise be to Allah, The Lord of the worlds. I testify that there is none worthy of worship except Allah and that Muhammad, sallallahu ‘alayhi wa sallam, is His slave and Messenger.
If the person touches a towel or clothes while performing ablution or Ghusl, then this has no effect at all on the validity of his ablution or Ghusl; i.e. they remain valid.
Allah knows best.