If you need rigid connections, you have to make triangles. For example:
Red lines represent joints.
And of course you should try to minimize the number of objects with joints.
Maybe build the line with just a few big sections using long invisible sprites with Physics. And draw a smooth visible line with small visible dots, pinned to Physics sprites.