Do I need to leave the USB stick connected for Wi-Fi?

No. The USB “CONFIG” stick is only used to import a network profile to /etc/NetworkManager/system-connections/ and can be removed.