Hi.
This is definitely shouldn’t work like that, so something is wrong.
First of all, are you using the latest versions of Stripe Payments plugin and add-ons? You might want to install Update Checker plugin for the add-ons: https://s-plugins.com/update-checker-plugin-for-the-addons/
Also, can you provide the URL to the payment page on your site?