You need to share a public link to your game.
Also physics are physics. You can have all of your objects that interact use them, or not but it is difficult to get good results with interactions between physics and non physics objects/behaviours.
Without seeing your game, your concept sounds simple enough to implement.
Give your ball sprite physics behaviour, plus any surfaces that it will contact. You can move the ball by applying physics forces to it. If the ball is on a physics object that is on an angle, it should naturally roll off it.