Instead of being a villain bent on ruling all of Hyrule, Ganondorf is the ruler of a traveling band of Gerudo warriors, traveling the desert and nearby regions to attack and pillage villages for supplies. Your village is the latest one in his sights.