Do people get annoyed when u knock on their doors and trick or treat?

Me and my parents get really annoyed so we take the battery out of the doorbell and don't answer the door. ive never done trick or treating and im 16. We see it as begging for sweets on random peoples doorsteps. if you know the people and they say its ok then of course its ok.