Click the "Edit" button in the right panel. You can move all of your structures, but only Improvements can be permanently deleted once they have been constructed. Remember that you can expand your Sector/Castle/Haven if you find yourself running out of space. You can also upgrade Defensive constructions to higher levels.