Covalent bonds with DNA bases are strong chemical bonds where toxic substances form a stable link with the DNA. These bonds involve the sharing of electron pairs between atoms, leading to a permanent connection that can interfere with the normal function of DNA.