Right click on filter and click "use expression".
Then you can use the ststem expression rgb(r,g,b) to choose colors.
Some Ideas:
Random color: rgb(random(255),random(255),random(255))
Random grey: rgb(1,1,1)*random(255)
Varied color around yellow: rgb(255-random(100), 255-random(100), random(100))