It's not for me, but I know it works for other people. As long as everyone involved is happy, there's open communication, honesty and empathy towards one another, then it can certainly work. You just have to be careful and make sure it's what you want. And if it doesn't work out, stop!
It's definitely something to read up on, though. It could make your relationship that much richer and meaningful for you guys, or it could get ugly. Jealousy is probably the biggest issue. Whatever you do, good luck!