Thanks for your help Coin Coin ! , but I think this won't work with the Tilemap, as the tiles are one whole object and I can't hide some tiles while other are visible.
Actually I can have the desired effect (hidden walls) if the walls of the TIlemap are black and the shadow is black too. Thus everything that is in the shadow merge together.
Anything else ?