Bleeding when fingering, inflamed cervix?

To preface my girlfriend and I are our firsts, but to get the the problem everytime I finger my girlfriend she bleeds. The first time I thought I broke her hymen but it’s happened again. When I first fingered her I felt a small ball at the very end of her vagina that I thought may be a cyst. But now I noticed it really was actually at the end of her vagina as there wasn’t any point beyond it. She likes it when I touch it but both times bleeding started when I did that. Is it possible she has an inflamed cervix that I’m irritating? Is it possible that I’ve just cut her with being too rough? Any answers will be appreciated, thank you so much 😄