Tertiary alkyl halides are least reactive towards the SN2 reaction because the bulky alkyl groups around the carbon atom hinder the attack of the nucleophile. The crowded environment prevents the nucleophile from approaching the carbon center effectively, slowing the reaction.