When I was younger, I wanted to be a commercial pilot. I got my PPL and was working towards my commercial while attending college and working at an FBO. Most of the (private/corporate) pilots I spoke with always said “find a job where you can afford to fly for fun instead of for a living.” I took their advice and switched careers.
Going into the career financially secure makes it much easier. I also have a friend who switched to aviation in his 40’s.
Id say if it’s a passion, do it for fun rather than a career because the career can take the fun out of it. Just my two cents as someone who flies for fun instead of a career.