While generally safe, individuals with certain conditions should be cautious with high doses of B12. Those with Leber's disease, a hereditary eye condition, should avoid high doses as it may accelerate vision loss. People with allergies to cobalt or cobalamin itself should also avoid supplementation. It is crucial to tailor vitamin intake to individual needs and medical history.