How to create a survey using Survey Galaxy

Designing surveys is easy; or is it? The reality is that writing surveys is easy but writing effective surveys is more difficult. The following are twenty tips that if followed will help you with your survey questionnaire design and help you write effective surveys.

1. What is the survey’s purpose?

There are many reasons for conducting questionnaires. By correctly phrasing the questions and structuring the answers surveys can be used in many ways and for a variety of reasons. When compiling a survey don’t lose sight of its purpose.

2. Title the survey

The survey title is a golden opportunity to instantly summarise a survey’s objective and encourage respondents to participate. Respondents are going to invest time in completing the survey so make them feel that their investment is worthwhile.

3. The length of the survey needs to be as short as possible

Every question asked should be asked for a reason. Minimize the questions providing you with ‘nice to know’ information and concentrate instead on the ‘need to know’ questions.

4. Use plain English, avoid terminology and acronyms, be consistent and ensure that the questions you ask will not result in ambiguous answers

Take care when wording a question. If a question can be interpreted in more ways than one then there is a real risk that any analysis of the resulting survey data will be worthless or at the very least suspect.

5. Avoid long questions

Use short sentences wherever possible. Long questions tend to cause respondents discomfort and can lead to a higher level of incidents where respondents abandon a survey.

6. Ask one question at a time

Avoid confusing the respondent with a question like ‘Do you like tennis and golf?’

7. Avoid influencing the answer

Avoid loading the question. ‘Should irresponsible shop keepers who sell alcohol to children be prosecuted?’ is unlikely to have any value.

8. Make sure that the selected answer format allows the respondent to answer the question being asked

Ensure that the respondent can answer how they really feel or they may be inclined to abandon the survey. As a last resort consider the benefit of including a “Don’t know”, “No comment” or similar response option.

9. When you are compiling your survey consider how the compiled data is going be analysed when the survey is complete

Appreciate that questions that allow for a free text open ended response is likely to be difficult to score and/or summarised. Consider grouping answers. For example “How long have you worked here?” – ‘less than 3 year’, ‘between 3 and 8 years’ and ‘more than 8′.

10. Try and ensure that the questionnaire flows

When asking questions group the questions into clear categories as this makes the task of completing the survey easier for the participants.

11. Target your respondents

In some cases you will want to target a specific group, in others a cross section. If you can’t control who responds to your survey consider including questions/answers that will allow you to filter out respondents who don’t fit your target profile.

12. Allow the respondent to expand on their answer or make comments

Allowing the respondent to make additional comments will increase their satisfaction level and will also give valuable feedback on the specific questions and/or the survey as a whole. Remember that for large sample collections that free text open ended responses may be difficult to analyse.

13. If you are conducting a confidential survey ensure that your pledge for confidentiality is upheld

If you have guaranteed the respondents that the survey is confidential ensure that the individual data is not to be shared with anyone and not used for any other purpose. Confidentiality must be maintained and any identifying information deleted after the survey is complete.

14. Consider the benefits and disadvantages of allowing respondents to be anonymous or identifiable

If your respondents are to be anonymous then you will be unable to follow up or match “pre” or “post” surveys. However in some cases allowing respondents to remain anonymous will allow respondents to respond without possible peer pressure.

15. Consideration carefully the best response format

It is good practice to maintain a consistency in the format used for responses. Keep in mind that when analysing the data radio buttons are easier to analyse than check boxes that offer the respondent multiple responses. Do not use a check box format if a radio response format would do.

16. Advise the respondent as to how much time the survey will take to complete

Respondent drop out can become a problem if the survey appears to be a stream of never ending questions. It is good practice to give an indication as to how long the survey is likely to take so that the participants can determine the best time to complete the survey.

17. Advise the respondents of the survey end date

Try and encourage your invited respondents to complete the survey as soon as possible but advise the respondents of the survey’s end date so that they have the opportunity to schedule the necessary time.

18. Test the survey

Before publishing a live survey publish a pilot survey to check for questions that are ambiguous or confusing and to confirm that the survey is aesthetically pleasing.

19. Before publishing the survey check the survey carefully

Check and then check again that a survey is grammatically correct and makes sense. If practical get a colleague to check the survey before you publish, if you are unable to do this then take a break before checking again.

20. Say ‘Thank You’

Respondents devote their time when completing surveys and should therefore be thanked at the end of completing the survey or in a follow up letter. You may even want to consider incentives such as a prize draw or reward.

Getting started is easy and there are many survey software websites to choose from.