A Green Party minister has said he was willing to leave Government if a land hoarding tax was deferred in the Budget.