Membership organisations are rarely short of member feedback. Many of the organisations we work with tell us they can predict who will respond first when a survey or consultation opens.
These are often highly engaged members who readily share their views at every opportunity. Their feedback can be valuable, but it can also create a distorted picture that isn’t representative of the wider membership. The most positive and most negative voices may be heard most clearly, while the quieter majority remains largely absent.
This matters, because hearing from members isn’t necessarily the same as understanding the membership.
The challenge of the ‘everyday member’
Ideally, every member would take part in research. In reality, that is never going to happen. The aim should instead be to hear from a broad enough mix to give confidence that the findings reflect the wider membership.
That means reaching the ‘everyday member’ – someone who may not attend every event, respond to every consultation, or engage with every communication, but who still uses their membership and has useful feedback.
Organisations are often aware that repeated feedback from the same highly engaged members can make results appear more positive than the reality. Equally, a small number of dissatisfied members can dominate the conversation and make problems appear more widespread than they are.
We also commonly see stronger participation from retired members. They may have more time and remain highly connected to the organisation. Meanwhile, members in the busiest stages of their careers can be harder to reach, even though their views may be particularly important when considering current pressures, services, and future priorities.
Encouraging broader participation
There is no single solution, but thoughtful research design can help.
Incentives can attract members who would not normally take part. Surveys should be short, relevant, and engaging, asking topical questions that members genuinely want to answer.
Promotion also needs to be carefully planned. A single email is unlikely to reach everyone, so organisations should consider reminders, newsletters, social channels, events, member networks, and personalised communications to less responsive groups.
The invitation also needs to feel relevant and accessible, explaining why members’ views matter, how little time it will take, and the difference their input can make.
Looking beyond the response rate
Membership organisations are often under pressure, particularly from senior stakeholders, to achieve a high headline response rate. While this is understandable, response rate alone is not the best test of whether research is reliable.
We have seen surveys achieve very respectable response rates and still attract criticism for not reaching more members, even where the number of responses provides a robust sample and the respondent profile closely reflects the wider membership.
Conversely, a higher response rate can still produce misleading findings if particular groups are overrepresented. The balance of those responding can therefore matter more than the headline percentage.
Respondents should be compared with the wider membership by characteristics such as age, career stage, membership grade, geography, and length of membership. Weighting can help correct imbalances, but is not ideal and can’t compensate for missing perspectives.
Where important groups remain underrepresented, targeted interviews, focus groups, telephone research, or shorter follow-up surveys can help fill the gaps.
Rather than focusing solely on how many members respond to a survey, we should focus on whose experiences are being captured, and whose are still missing.
The more closely research reflects the core membership, the more reliable and useful the insight generated will be.
Enventure Research helps membership organisations design research that reaches beyond the loudest voices and generates a clearer, more representative understanding of member needs.
Leave A Comment