O2 is a slightly different beast.
You're inhaling it. The stomach is designed to deal with all sorts of nasties. It will vet them, and usually manage to eject what's not good.
The lungs aren't quite as capable and will much more readily absorb or deposit what gets in.
Oxygen for medical purposes is designed to be safe for round the clock use for long periods of time. As I mentioned before, the lungs aren't great at ejecting what gets in, and so if there's just a few impurities, they can accumulate.
I'm sure I needn't mention that the gut is
very good at expelling what gets in

.
Of course, the impurities may be unimportant, but if you're running a medical supply company and someone will be breathing your product every day for 24 hours for the foreseeable future, the last thing you want is to be implicated in their death.
TL;DR
Oxygen is used for a long time in the lungs. Things accumulate or are absorbed and can be dangerous.
CO2 in drinks is used for a short amount of time. Gases are burped out and solids are excreted. It shouldn't be dangerous.