Big enough but not too big.
Seriously. It's a personal thing that depends on your body arrangement and capacity. To an extent, the bigger the toy the more the stimulation (especially against the prostate), but too much and you can't use it comfortably.
I'd say 1.5" diameter is a good minimum size, silicone toys that big are stiff enough for some good prostate play.