How to make OCR recognize Upper and Lower case letters with similar shapes

I'm having trouble with Upper and Lower case letter recognition. For instance, I'm trying to read 'c' but it keeps returning as 'C', same goes for the letter O/o or any other letters with similar upper and lower case shapes. My classifier is trained using a dataset which contains both upper and lower case samples from the emnist byclass dataset.