In general it's not recommended to install stuff over SSH since App Service instances are ephemeral so any time there is a VM rotation your app would be broken in that new instance requiring you to SSH and install the component again.
Since it sounds like you are using python for your app, the way to go would be to include sqlalchemy
in your requirements.txt