The Touch object has dedicated triggered conditions.
In this instance, prefer using "On touched object" which will trigger once a touch pressing down and releasing occurred (the event happens on the release).
This should prevent the issue of clicking the next button in the next layout.
Otherwise, do put some delay to your button by setting a global variable "isTouched" for example to a different value when you touch a button.
As an additional condition to all your button touching events, check the value of this isTouched variable.
When you click a button and that "isTouched" is false, do the action you want to do in regards to that button and do also change the value of "isTouched" to true, and start a timer (0.25 is a good spot in my experience) that will change back the value of isTouched to false when it happens.