Azure enterprise application access to all user

Hi   I was hoping someone can shed some light on this. I added an SSO Enterprise application. We are not auto=provisioning and don't want to restrict the Azure connectivity to a small group. How ca...