How to manage garbage collection not to disrupt services on web application

Greetings, 

I need your expertise, to resolve a painful issue regarding Gc process always running on my stand-alone servers causing disruption.

I limited my IIS to always run recycle after reaching 20gi of memory consumption, I also set the site to use server gc , but all the time my servers are undergoing Gc which disrupts service.

Any solutions over there to get off this nightmare