I made the same decision over a decade ago, to forgo an intensely competitive academic career to spend more time with my young family. My kids are now grown up and my job as a father is done, and I feel like I've enjoyed a level and kind of success that my more career-oriented peers can't even imagine (if they could, they'd be pursuing it!) There are all kinds of alternative opportunities once we open our eyes to them: I ended up founding and running a scientific consulting company that let me earn a good living and spend far more time with my kids than any conventional career. Best of luck!