Will I be able to tell if it's the leak sensor or probe that detects a leak?

Yes, the Wyze app can tell you which device detected the leak.

Use the Wyze app to differentiate between the leak sensor and the probe, and which has detected a leak. You can also disable this feature.