Yes.

This is explicitly stated in the rules.

> Thus, you may destroy a cost one district for free