I've used EasyOCR for number recognition tasks. Works fairly well. https://github.com/JaidedAI/EasyOCR

Tried to speed up recognition by running task tuned segmentation model and cropping input image on good detection but EasyOCR seemed to work better without it.