Do I have to have the Wyze app open while using the scale?

No, you don't need the app open.

Step on the scale with the Wyze app closed, and the scale will store your data until you connect to it with your phone. Once connected via Bluetooth, the scale will sync and upload your measurements to the app.