So, 10 minutes ago I played with friend in Dueling Nexus. I used Infinite Impermanence on his Number 101: Silent Honor ARK and he wasn't able to detach two materials in order to take one of my special summoned monsters. However, he could actually prevent destruction by detaching one material.
I activated Infinite Impermanence, then chained with Torrential Tribute; I assume that the problem comes from that both effects are in the same Chain Link. Could this be the case?