Found an article from this website, hopefully that will fix my issue.
Quit Boxcryptor. (Skip this step as the app was deleted already)
Open the System Preferences → Extensions → Finder and disable Boxcryptor.
Delete the following folders:
Note: The /Library denotes the user library folder and NOT the system library folder.
Remove application preferences by executing the following command in the Terminal app: defaults remove com.boxcryptor.osx
Open the Keychain Access app and remove all entries starting with com.boxcryptor.osx.
Move Boxcryptor.app into trash. (Skip this step as the app was deleted already)