Probably not. Silicone lube rests on the skin and inner tissue and may cause reactions in some people. Or it could be an other ingredient in the lube itself. Glycerin is a common problem in lubes, as are flavorings and other ingredients.
Silicone vibrators (if 100% silicone) very pure, inert to the body and I have never heard of any one being allergic to pure silicone vibrators, dildos, butt plugs, rockets, bullets etc.