I would just use a separate detector sprite. While using the custom collision mask may be convenient, for this type of problem, you're making the problem far harder. If you're trying to find an angle and the act of testing an angle changes the collision mask, you're already in an order of magnitude harder problem than using a separate hitbox.