Does the Town need to worry about the tax agreement being assigned to another party?

No.  Under the agreement, it cannot be assigned unless all defaults have been cured.