You can exile your opponents' Plains before Ulamog resolves, but you can't stop your opponent from getting mana from them. Assuming no one has anything else to do besides the things you mentioned, it'd go like this:
- You cast Ulamog.
- Ulamog's "when you cast..." ability triggers, and you target your opponents' two Plains.
- Your opponent taps both Plains for white mana, leaving it in their mana pool. (They float two white.)
- The triggered ability resolves, exiling both Plains.
- Ulamog resolves, entering the battlefield.
- Your opponent spends one of the white mana to cast Path to Exile.
From your question it sounds like you might be thinking of lands and mana as being the same thing, but as that sequence of events pretty clearly shows, the lands are separate from the mana they produce.