Quote from Ashley:
[quote:1mmytww9]Layers have no performance impact unless you change the layer opacity, blend mode, enable "force own texture", or add WebGL effects. Otherwise there is no reason for layers to reduce performance.
So basically, what you do with the Layers is the main factor.