I think I feel the same way a lot. Family and time matters more at my age. Would be different if I was 21 of course.
I remember going to Wembley stadium to watch city recently. We drove on the north circular and parked up some side street.
It brought back to me its a city polarised more than any other place I've been in the UK. Wealth like you can't imagine yet absolute poverty in almost any borough.
You're spot on : I was 18 when I went and central London was fantastic. I even felt safe at night as it was buzzing . Loads of people around, pubs, clubs , theatre etc. Amazing.
But most people live in places no better than any parts of Coventry. Most people can't afford a house of any kind and live in flats or rentals.
I left in the end because we wanted to start a family, have a house, garden, open spaces, visit other towns villages etc. Simple as that .
Getting In a car in any part of London and driving even 5 miles at the weekend to a big park was a nightmare. In the end, the quality of life I wanted wasn't what London had to offer.
Your family is important. Have you spoken to them about it ? List your priorities and see where they stack up if you take the job and if you don't.