When I try to meditate, my mind wanders off?

Yes it will happen. This is because you are trying to meditate without the pre-meditative practices of Karma Yoga Bhakti Yoga and Jnana Yoga which help reduce your desires. Only then are you prepared for meditation. So, stop meditating and go back to these practices. Therefore we recommend the study of the Bhagavad Gita on a daily basis.