Yeah, if I don't then I get stuck in full lobbies. I hate playing with randoms in that game so I always play alone or just with friends.
Sometimes even with the MTU trick I still get people joining my session. If it stays at around a handful, things are usually cool. ....but when it grows or if I start seeing "X killed by Y", then I bail.
Sometimes if I wait folks will start leaving in their own and then I'm all by myself again.