No, they can't. You lose only Troops and Resources if you fail to defend your Sector. The stronger the enemy force is, the more units and Resources you will lose during a defeat.
Please note that your Extractor Rig/Altar of Weor can be destroyed in case of successful attack.