One way to do it would be this:
On object clicked
.. set lastTouched : object.UID
On button clicked
pick object by UID lastTouched
.. object destroy
So every time you click on object you save the objects UID to a variable. When a button is pressed, we pick the object indicated in variable and destroy it.