Question about growing vegetables and soil?

How safe is it to plant vegetables in a garden when you don't know if the soil has been sprayed with weedkillers, chemicals etc. Most gardeners I've seen use regular sprays of chemicals on gardens...so is it safe to grow stuff in the ground or should I purchase pots and then buy potting mix or something?