Networking out Private VNET in AZURE with a third party app such as payment gateway?

I need to do networking so that my VNET in Azure connects to third party applications such as payment gateways or messaging apps which are in Public internet. Please let me know the options and why we should prefer one over the other?