Caffeine's safety profile varies among different populations. Pregnant women are advised to limit their caffeine intake to reduce the risk of complications such as low birth weight and preterm birth. People with heart conditions, anxiety disorders, or certain metabolic disorders should also be cautious. Additionally, genetic differences can affect how individuals metabolize caffeine, making some people more susceptible to its negative effects.