Lack of Physical affection with a person I’m seeing

I’ve been seeing this guy for a few weeks. We’ve hooked up a few times but we don’t have much physical intimacy outside of sex. Im usually a very physically affectionate person. Should I bring it up to him or see if it grows and unfolds on its own?