In the events that I help organize, I try to solve this problem by giving people explicit permission to join new groups of people.
Neat little conference hack. Reminds me of a post I wrote a few years ago. Social situations can be cause for a lot of anxiety. It’s always good to know that folks are looking for ways to avoid this.