The invasiveness of a substance is determined by several factors, including its chemical structure, lipophilicity, molecular size, and ability to bypass or damage biological barriers. Substances that are lipophilic can easily penetrate cell membranes, while those with smaller molecular sizes can pass through tight junctions between cells.