The idea was to store the scale in relation to the original sprite size.
(So setting the scale to 2 would double the sprite size, and later setting it to 0.5 would not bring it back to 100%, but make it 50%)
Well, I managed to track the object's scales by using width/imageWidth. It turned out nicely.
The test:
gamma-beam.com/construct/blooms