I would have voted for both glass and metal.
I love silicone toys, but you have to be careful with lubes around them. We only use water based lube, as most of our toys are silicone, and I don't like the feel of silicone lube. It isn't a problem.
But, if you prefer lubricants other than water based, stainless steel and glass are going to hold up.