First, download the latest Zoom pkg installer from:
Run the following commands to extract the zoom.us.app and install it to your Applications:
$ xar -xf zoomusInstallerFull.pkg
$ cpio -i --file zoomus.pkg/Payload
$ sudo mv zoom.us.app /Applications
Instead of running the last command as sudo, you can just drag and drop the zoom.us.app to your Applications folder.
Now Zoom is installed on your Mac without having to install it with the bundled packager and using Admin permissions. I personally also disable Zoom auto updates and update Zoom manually when I have to.