At your age, with your income and retirement savings? Go for it assuming you personally want to own, can afford to keep maxing your 401k with a mortgage, and aren’t on a hardcore FIRE path. Maybe even if you are. Yes that money will snowball if you leave it alone, but how long before it matters? Will you be happier using it to pay in cash in a decade, or will you appreciate the decade in a house more? I bought at 28 with less for a down payment and I’ve never regretted it.