Participatory Design (PD) aims to promote inclusivity by involving users throughout the design process. However, Human-Computer Interaction (HCI) and social computing research have pointed to instances where PD as practiced can, paradoxically, be exclusive. We aim to understand some of the challenges that could lead to exclusivity in order to design more inclusive PD practices. To investigate this, we conducted interviews with ten expert PD practitioners based in the Global North whose focus is on inclusion. Synthesizing practitioners’ accounts, we advance understandings of challenges surrounding: 1) instantiating shared spaces that empower partners; 2) developing common ground among stakeholders; and 3) balancing funding needs with open-ended PD. We contribute theoretical and empirical insights into these challenges and close by articulating potential implications for addressing these challenges to inclusion in PD.