A valet driving off with your car would also be theft by deception, the crime you are describing. This isn't a crime in every state, but there is no state where you can be charged with grand theft auto if you have the keys unless you also committed robbery/breaking and entering to get the keys. That "permission" you discussed is what eliminates culpability on the driver's part. You can't withdraw permission anytime you want and make it a crime.