>So model.fit is an inbuilt function for training the model which I don’t want to use. I want to define the model on my own

just use the UNet using that runs with model.fit() and implement your own training loop following this guide: https://lukewood.xyz/blog/keras-model-walkthrough