Do I have to leave the app open during the transaction?

No, you can close Gaiyo during a transaction. Do not log out however, so that you can stop the transaction.