It's solved, after a day of testing found the solution (and it was so simple lol)
All I had to do was, instead of syncing objects just on start of layout, add another event for the host to attempt to sync objects once every player is created. It worked!
Had to remove the trigger once later, though. Now it worked fine