If the outlet's Wi-Fi is disconnected, will it still work?

Yes, mechanical on/off can still work without Wi-Fi.