Finaly got around to work on this again after a longer gamejam.
Optimized it, before the CPU + GPU would easily spike up to 60% with around 250 drawingCanvas.
Now it holds steady around 20% with around 250 drawingCanvas.
*All the drawingCanvas have physics on them too, which currently is what makes them move around. (because i intend to use it for a spacegame)