If your safeties are in zone, you could just interfere with your safety. The X-box refs never calls interference

. Just don't do it until the last moment and make certain you either attempt to intercept or swat, it lessens the chances even further. I've never had a call for it.
In man with no safeties, yeah, you're screwed if you can't time the DB's swat just right. But, hey, if you man up your safeties that's the risk you take.