Should I Date This guy?

I need some advice. I really like a guy who is my colleague. We are both junior high teachers. He is a nice guy and is sweet, humble, and is active in the community. I am interested in him since he shares similar qualities as me. He is also handsome, chill, and down to earth. I am just fearful of going out on a date with him due to what others think. He is a White Jewish guy and I am a African American woman. Some of my family members and friends think I should not date a white guy. I am don't want to get rejection from my peers, but I don't want to limit my options to just dating inside my race. Please help!