You don't have to say you're straight. You can call yourself something else if it feels right for you.

I personally call myself bi even though I've only dated one woman. The truth is more complicated. I only find women attractive, I only enjoy sex with men (or trans/nonbinary people with penises), and I can love people of any gender.