You really don't want to ingest large amounts of any lube, flavored or non. It's for licking, not chugging!
Water-based is generally safe to ingest in small amounts. Silicone lube might not hurt you in very
small amounts, but I hear it tastes bad and can make your mouth feel funny.
Like ToyGeek said, swallowing too much of any kind could make you feel sick.