>I have a background in administration but honestly none in banking.

Lead with that. "I'm really interested to see how different banking is from the administration work I'm experienced in. Banking is administration of money, so it seems like a good foundation to build on."

It shows you're interested in taking on something new and you have good skills that may give you an advantage.

Good luck in your interview!