Online Skills & Competence Analysis Tool


INDEX


 

Survey Design and Structure

A survey has three integral elements. Every survey must have:

Optional elements to a survey include:

The Survey Name is the name of the survey, and the place where various options are set that relate to the survey as a whole. Options such as the “Definition” message, the “description” of the survey, contact information for the survey administrator, what “format” the survey will appear in, and so forth.

Each survey divides the questions into groups. This allows for logical organisation of the survey into groupings of similar questions. A group has a title and an optional description. You must have at least one group in each survey, even if you don’t wish to divide the survey into multiple groups.

Questions are the core of your survey and fit into a group, as explained above. There are no technical limits to the number of questions you can have in your survey, or the number of questions per group. Questions include the actual question itself, as well as settings that determine what type of answer you expect. You can also include a short “help” explanation for each question and determine whether the question is mandatory (ie: must be answered before continuing).

Question Types
There are two kind of questions:

1. questions that allow ASSESSMENTS
2.
questions that DON'T allow assessment:

ASSESSMENT
Using these kind of questions authors can benefit the assessment function of the tool.

NO ASSESSMENT
Using these kind of questions authors can only gather users' choices and can't benefit the assessment function of the tool.


Creating Surveys

  1. Creating a NEW SURVEY

    To create a new survey click on the Add button at the right hand side of the administration button bar.

    The "Create New Survey" screen will appear below. Following is a description of each field:

    1. Title: This is the brief descriptive name of the survey (ie: "Teamwork", or "Communication"). This title will be displayed on every page of the public survey script.

    2. Description: This allows you to enter a description of the survey. (ie: "A survey to collect your ideas on the next round of enterprise bargaining" or "A survey to find out the popularity of chocolate ice cream"). You can use html markup in this section.

    3. Definition: This allows you to enter a text that will display when a participant first logs into your public survey screen. You can use html markup in this section.

    4. Administrator: This is the name of the contact person who administrates the survey. It will be included in any emails sent out inviting participants to respond.

    5. Admin Email: This is the email address of the administrator (as above) and is used as the 'reply to:' address on any emails sent out.

    6. Fax To: This field is used to give a fax number on the "printable survey" - ie: when you want to send someone a hardcopy because they cannot use the online survey.

    7. Format: Choose from "One at a time", "Group at a time" or "All in one".

      • Question by question Public survey will display one question per page.

      • Group by group Public survey will display all questions in a group per page.
        Group at a time surveys still have a separate "welcome" page and "submit" page, like "One at a time" surveys.

      • All in one Public survey will display all questions in one single page
        All in one surveys do not have a "welcome" page or "submit" page - the welcome message and submit button all appear on the same page.

    8. Use Cookies?: If you choose "Use Cookies" and your survey does not use a tokens table to control participant access, then a cookie will be saved to the client computer of each survey participant once they have submitted a survey. This cookie will stop the same computer from accessing the survey more than once. There are inherent limitations in the 'security' strenght of such a system, but on a general basis it allows public surveys to retain some control over multiple entries. The default value is "no".

    9. Allow Saves?: If you set this option to "Yes" then users can save unsubmitted surveys and return to them later.
    10. Show [<< Prev] button: This option defaults to yes, however if you set it to "No" then users will not have the option of moving to a previous page while completing the survey.
    11. Notification: Options to allow the administrator to be emailed when each individual survey response is saved. You can choose from:
      • No email notification - self explanatory

      • Basic email notification - an email is sent informing the administrator that a survey response has been saved

      • Send email notification with response codes - sends the full answers to the survey after saving

    12. Anonymous: This allows you to determine whether responses to your survey are matched up with information from your surveys tokens table, or kept 'anonymous'. The default is yes. If you choose "No" for anonymous, you must also have a tokens table for your survey when you activate it.

    13. Invitation Email Subject: The subject line for the invitation email that gets sent out when tokens are used with your survey.
    14. Invitation Email: This is the text for the invitation email that gets sent out when tokens are used with your survey. This is initially filled by the default invitation message (from the language files) but you can modify it to suit yourself. Of course if you don't plan to use tokens on your survey, whatever is in this field is irrelevent.
      You can use the following "form" fields to insert individualised information in each email:
      • {FIRSTNAME} - gets replaced with the token table's "firstname" value

      • {LASTNAME} - gets replaced with the token table's "lastname" value

      • {SURVEYNAME} - gets replaced with your surveys name

      • {SURVEYDESCRIPTION} - gets replaced with your surveys description

      • {ATTRIBUTE_1} - gets replaced with the token table's "attribute_1" value

      • {ATTRIBUTE_2} - gets replaced with the token table's "attribute_2" value

      • {SURVEYURL} - gets replaced with the fully qualified URL to this particular survey

      Note that these "form fields" apply to the following email fields.

    15. Email Reminder Subject: The subject line for the reminder email that gets sent out from the tokens tool
    16. Email Reminder: This is the text for the reminder email that gets sent out when tokens are used with your survey. See "invitation email" for specific details on how this field is used.
    17. Confirmation Email Subject: When tokens are used, this is the subject line of the email that gets automatically sent to participants after completion of the survey
    18. Confirmation Email: This is the text of the email that gets sent to users after completion of the survey.
    19. Allow Public Registration: If you use tokens to control access to your survey, the only people who can use the survey are those who have an entry and a unique token from the token table. If you would like to use the tokens but allow public registration, use this field. Setting "Yes" to this will allow a visitor to your Survey URL to register their name and email address. The script will create a new entry in your tokens table for this person, then send them an invitation email. The script will ensure that only one person per email address can complete your survey.
    20. Public Registration Email Subject: This is the subject line for the invitation email sent to members of the public who register for a survey.
    21. Public Registration Email: This is the text for the invitation email sent to members of the public who register for a survey.
    22. Token attribute names: The tokens table has two "spare" fields for storing additional information about users. When using the public registration system, you can use these two fields to give your attribute fields a nice name for the public. So, if you are using "attribute_1" to store the participants department name, you can label it appropriately.
    23. Datestamp?: This field allows you to determine whether the survey will datestamp all responses. If you choose "Yes", then when a response is submitted, a field will be included in that response indicating the time and date that the response was made.
    24. Language: A list of the possible language files will be shown next to this option. Changing the language setting here will change the default language used when participants use the public survey scripts (but will not change the administration language).
    25. Expires: This is the last date on which the public survey script will let people participate. (Read this twice... if you set it for the 31 of December, then people will no longer be able to use the survey script on the 1st of January).
    26. End URL: This URL will be presented as a link at the end of the survey, and allows you to direct your participants back to your home page (or, in fact, anywhere).
    27. URL Descrip: The description for the link using the End URL.
    28. Automatically Load URL when survey complete: If you choose "Yes" for this option, the script will automatically load the URL as set in "End URL" after completion of the survey, instead of displaying the usual "Completed" page.
      NOTE: Do not use this if you are using assessments.

    Importing a Survey
    If you have previously exported a survey, you can import it from the "New Survey" screen. Click on the browse button to choose the sql file, and then click on the
    button. The import process reads a 'sql' file created by the tool and 'intelligently' renumbers the survey, group, question, answer and condition id's so that they all match each other. See section on Exporting a Survey for more information.

    (B) Creating a NEW GROUP

    Before you can add any questions to your survey you must create a group. If you will only have one group in your survey, then how you name this group is irrelevant (except of course for show). If, however, you are going to have multiple groups, you should note that the survey questions will be displayed by group, and the groups will be displayed in alphabetical order. So, if you really need the groups to be displayed in a particular order, consider naming them with an alphabetic start such as "A) Questions about you" and "B) Questions about health". Doing it this way will ensure that your groups are displayed in order. If, for example, you entered the group names as "Questions about you" and "Questions about health", the "Questions about health" group will display first, because alphabetically it comes first. PHPSurveyor is designed to do this deliberately, because it allows you to add extra groups in later, and arrange their positioning by adjusting the title. For example, you could squeeze an extra group between the two by naming it "A1) Questions about your history".

    You can create as many groups as you like.

    Groups can also include a "description". This field allows you to publish an explanatory note for any set of questions. If you add a description, then when the public are using the public survey system, they will be presented with that explanation before commencing any of the questions in that group. If you do not include any text here, then public participants will simply move on to the first question in the group with no stop.

    Create a new group by clicking on the Add icon in the Survey Button Bar.

    (C) Adding a QUESTION

    Once you have created your groups, you can start adding questions within each group. Create a new question by clicking on the add icon (add) on the right hand side of the "Group" menu bar.

    When adding a question, you will be asked for a "Question Code", the "Question", "Help" and a "Question Type". All new questions are assigned to the Group you were viewing when you clicked "Add Question", however you can change the group the question belongs too at a later point.

    1. Question Code: Your ID, or number or code for the question. This field is important, because the entry in this will determine the positioning of the question in your survey. Again, numbering this "Q1", and following questions "Q2" and "Q3" will ensure that they appear in the correct order. Using this system allows you to add in extra questions as an afterthought by giving them a code such as "Q1a". Try to be consistent with your coding in this field. Planning makes this process a lot easier.
       

    2. Question: This is the actual question being asked. There is no real limit to the length of the question here, however if you want to explain the question, leave that for the next field.
       

    3. Help: This is an optional field. It is useful if a question needs some explanation, or you want to explain how it should be answered. When you put text in this field, a "Question Mark" icon appears on the survey entry screens, and clicking on this allows the survey participant (or data entry person) to read the help.
       

    4. Question Type: This determines the type of response the survey allows. View the "Question Types" section for a description of the various options available.
       

    5. Validation: This feature is available on all free text type questions ("Short Free Text", "Long Free Text", "Date" or "Numerical"). You can use standard Perl Regex expressions in this field to validate the responses to the question, and if the responses don't validate against this expression, the user will be prompted to try again before they can progress.
      Perl Regex expressions must start and finish with a forward slash ("/").

    6. Other? Depending upon your chosen 'question type' this option may appear. It allows you to specify that an "other" option be presented in some of the list question types.
       

    7. Mandatory? For all question types, except the text ones, this setting allows you to require users to answer the question, before they can move on to the next question.

    You can create as many questions as you like.
    When you have created a question that uses pre-determined answers (ie: dropdown list) you can then add answers to that question.

    (D) Setting Conditions (Branching)

    A question can be set to display ONLY IF certain conditions are met. You can set these conditions by clicking on the Conditions icon in the question button bar, when viewing a question.

    When you choose "Set Conditions" a new window will appear allowing you to delete or create conditions for the current question. An example is show below.

    Condition Designer
    Only show question 02-07bPlease specify which disease(s) IF
    02-07: Have workers or former workers.. (qid510) Equals
    Yes (YES)
     
    Copy Conditions
    Condition   Question
    copy to
     
     
    Add Condition
    Question   Answer
    Equals
     
     
     

     

Existing Conditions
The top part of the window shows any conditions already set for this question, and the bottom part allows you to create new conditions.
New Conditions
To create a new condition, click on the question (left hand column) that you wish to use for your condition. When you have chosen a question the Answer section on the right hand side will display the possible answers for that question. Choose the answer that you want to use, then click on the "Add Condition" button. You can choose multiple answers in one go by using the CTRL button and clicking on more than one answer in the right hand select list.
Multiple Conditions
You can set more than one condition to apply for a question. Conditions can be based on more than one previous question. So, for example, you can set a question to display only if the answer to Question 1 is "Y" and question 2 is "N". Or only if the answer to Question 1 is "Y" or "No answer" and the answer to question 2 is "N".
Copying Conditions to Later Questions
It is not uncommon for a group of questions to have the same condition. If you set a condition for one question, you can copy this condition to any subsequent question from the conditions designer. Once a condition has been set, the following screen will be displayed:

Copy Conditions

Condition

 

Question

copy to


The select box on the left displays the conditions already set on this question, and the select box on the right shows all subsequent questions in the survey. Highlight all the conditions on the left side that you wish to copy (using the CTRL key to select multiples) and then highlight all the questions you wish to copy these conditions to on the right hand side (using the CTRL key to select multiples). The click on the "Copy Conditions" button to copy them across. It is usually best to leave this until you have finished entering all your survey questions, and are satiisfied with the question order.
Things to watch out for
If you set conditions on a question that, itself, has conditions, then there may arise occasions where the survey behaves in ways you might not have predicted. So if you are designing a complicated survey with large numbers of conditions, make sure you test the survey for as many different combinations of results as you can think of. In the above example, a question is displayed 'Do you like being male?' which has conditions set, and which will only display if the answer to "what is your gender?" is "M". If you were to add a condition to this question requiring a specific answer from the "Do you like being male?" question, then this question will never display, because the question "Do you like being male" will not be presented. If this seems confusing, don't worry too much, because when you are designing your survey the logics of these conditions will make themselves far more clear.

There are a few basic rules you should keep in mind before setting conditions on a question.

    1. Once a single condition has been set for a question, that question WILL NOT DISPLAY unless that condition is met.
    2. Conditions can only be set based on questions that appear BEFORE the question on which the condition is set.
    3. Multiple conditions based on a single earlier question are evaluated using boolean "OR" principles. Multiple conditions based on multiple earlier questions are based on boolean "AND" principles. This is important because it means you cannot (for example) set a condition that a question will only display if either previous question a is "Y" OR previous question b is "N".
    4. You can modify conditions even after a survey has been activated. This should be done with caution, as there is no "consistency checking" applied here.
(E) Adding ANSWERS
Various question types require you to add a list of 'answers' from which the survey participant chooses, or which are used as headings for responses. To add answers to one of these question types click on the Answers icon in question button bar.
When adding an answer you will be asked for an "Answer Code", an "Answer" and whether that answer is the "Default".
(F) Exporting a survey
The Export
button
in the survey button bar will dump all the groups, questions, answers and conditions for your survey into a standard sql dump file. This dump file can be used with the 'Import Survey' feature.


Testing a Survey

You can test a survey at any point while you are creating it, by choosing the Export button in the 'Survey' section of the web page. This allows you to check how the survey looks and feels, before you actually initialise it. When testing a survey your responses will not be saved.


Assessments

Assessments are rules which evaluate the responses to the survey immediately after it is submitted, and can then display text based on that.

As an example, consider the following. You have two questions in your survey, the first question asks if the user smokes: "Do you smoke?". The question has 3 possible answers, "Yes more than 10 per day" with an answer code of "10", "Yes, but less than 10 per day" with an answer code of "5" and "No, I don't smoke at all" with an answer code of "0".

The second question "Do you exercise?" has three possible answers; "Yes, I exercise for at least half an hour three times a week" with a value of "0", "Yes, I exercise every now and then" with a value of "5" and "No, I don't ever do any exercise" with a value of "10".

If we were to add the totals of the values for each possible answer at the end of the survey, we'd have a good indication of the general health of the respondent. Someone who smokes and doesn't ever do any exercise will have scored 10 in each of their answers, giving a sum of 20 when we add the values together. Someone who doesn't smoke and exercises regularly will have scored 0 in each of the answers with a total of 0 when we add the values together.

The assessments tool allows you to set some rules based on the summed values of the questions in the survey, either for the Total survey, or for each Group within the survey.

If we visit the assessments tool from the survey administration toolbar, we can create some assessments for this survey. From this screen you can view, edit or delete existing assessments or create new assessments.
 

If you create any assessments in this page, for the currently selected survey, the assessment will be performed at the end of the survey after submission
ID SID Scope Group Minimum Maximum Heading Message URL Actions
11 35 T 94 20 20 You are very unhealthy You are very unhealthy. You should stop smoking and start exercising http://www.healthy.com/
Add
Scope
Group
Minimum
Maximum
Heading
Message
URL

In the "Add/Edit" box you can choose the following:

Scope: The scope of the assessment. Choose either "Total" which will create an assessment based on the sum of all the answers in the entire survey, or "Group" which will create an assessment based on the sum of all the answers in a group (chosen in the next row)
Group: If the scope of this assessment is for the current "Group", this is where you choose which group to assess.
Minimum: The minimum "sum" of answers to which this assessment will apply
Maximum: The maximum "sum" of answers to which this assessment will apply
Heading: The heading of the assessment which will display if this assessment is shown
Message: The actual message for this assessment (it may include html code)
URL: A URL link which will display with this asssessment.

You can create as many assessments as you like, and you can create more than one assessment to display for a given score.

It is important to note that if you use assessments, you must ensure that you have not chosen to autoload the URL at the end of the survey in the general survey setup, because the assessments only show on the final "completed" page after submitting a survey.


Activating a Survey

Once you are happy with the structure of your survey you can activate it. Activating a survey does a number of things.

  1. It creates a separate MySQL table to hold all survey responses, and gives each possible answer to the survey a field in that table.

  2. It allows people to enter data into that table, and gives you access to other features for the survey, including browse and token facilities.

  3. It gives you access to the "tokens" feature. Once a survey is activated, the "tokens" button will be available (see section on Tokens).

  4. If your survey is set to "not anonymous", a tokens table will be created automatically.

Before you activate a survey you should note the following points:

Activate a survey by clicking on the button in the survey button bar.


Browsing Survey Responses

Once a survey has been activated, and survey responses have been submitted, you will want to be able to view those responses, maybe edit some of them (or possibly delete some), export them, get some information about the responses received so far, and so on. All of this is done through the "browse" function.

When your survey is active, a 'Browse' button ( )will appear in the Survey Information portion of the main admin screen. Clicking this button will open the "Browse" screen. An example is shown below.
 

Browse Responses: CPSU EB2003 Survey
- |
The main screen (Survey Summary) gives you just a quantity of responses to this survey so far. The other options are described below:

Data View Control:

--   

 Records Displayed: Starting From:

Editing and Deleting Responses
When viewing your reponses, you will be able to view a specific response by clicking on the id number. An example of 'browse' responses is shown below.
 

id

What is your Employment Type?

What are your Hours of Work?

What is your Spread of Hours?

What is your Gender?

What is your Classification?

What is your Top Priority for outcomes of the next Enterprise Agreement?
This might be something new, an improvement to existing conditions, or ongoing inclusion of a condition you value.

What is your Top Priority for outcomes of the next Enterprise Agreement?
This might be something new, an improvement to existing conditions, or ongoing inclusion of a condition you value. (comment)

1

A

A

A

F

A

I

Please pay us more money.

2

B

A

A

F

B

J

Possibility of further tertiary study and working that in with my current job.

Clicking on the hyperlinked id number will present the 'view record' screen:
 

Viewing Answer ID 1

id

1

What is your Employment Type?

Full Time [A]

What are your Hours of Work?

76 Hours Per Fortnight [A]

What is your Spread of Hours?

9 to 5 [A]

What is your Gender?

Female [F]

What is your Classification?

Administrative Officer [A]

Do you manage staff in your current job?

No [N]

What is your Region/Division?

Health Sector [H]

What is your Top Priority for outcomes of the next Enterprise Agreement?
This might be something new, an improvement to existing conditions, or ongoing inclusion of a condition you value.

Increased Salaries [I]

What is your Top Priority for outcomes of the next Enterprise Agreement?
This might be something new, an improvement to existing conditions, or ongoing inclusion of a condition you value.
[Comment]

Please pay us more money.

From this point you can choose to "Edit" or "Delete" this response.

Deleting the responses is, of course, fairly self-explanatory - and as anyone who regularly runs surveys would know, is not recommended, unless you've got a pretty good reason (ie: a doubled up entry, or some sufficiently serious reason as to why it should be deleted). Don't click on this button thinking it will give you a second chance. If you click "Delete", the entry will be deleted with no second guessing or second checks.

Editing the response is also fairly self-explanatory. It will take you to a 'data-entry' screen with the responses provided, and allow you to make and save any modifications. Again, in a survey you generally don't want to make changes to the responses made by the participants - but hey - it's your survey. Do what you want!


Tokens

On many occassions you will want to invite a group of people to participate in your survey, keep track of who has completed the survey, and ensure that each person can only participate once. Tokens can be setup once a survey has been activated. The tokens feature allows you to do the following:

Once you enable tokens for a survey, then the only people who can access the survey are those who have been issued a token number. Access to the public script will rely on the participant being able to provide their unique token id.

Tokens can be matched to surveys that have been set up as "not-anonymous". This is determined when creating a survey. If a survey is not anonymous (or 'tracked') then the token list can be used to find the particular response that an individual has made to the survey. If the survey is anonymous, then no link is available between the tokens table and the responses.

The following is a brief rundown of the menu options in the tokens screen:

Database Admin
While the summary screen shows a brief summary of tokens in the table, it also provides access to the "Database Admin" features which include:
Using the browse screen
The browse screen will show you a list of all entries in the tokens table, as well as giving you some 'action' buttons that can perform specific tasks for that individual entry.
The top row of the table gives options for displaying a number of records, and a starting point.
The second row of the table includes the field name, and a green arrow that - if clicked - will refresh the screen showing the tokens ordered by that field.
The last row of the table lets you move backwards or forwards through your list (based on the settings at the top).

Showing

records starting at

Sort by IDID

Sort by IDFirst

Sort by IDLast

Sort by IDEmail

Sort by IDToken

Sort by IDInvite?

Sort by IDDone?

attribute_1

attribute_2

Action

1

a

a

a@a.org

0829007266

Y

Y

 

 

 

2

b

b

b@b.org

1371896219

Y

 

3

c

c

c@c.org

R193857398

Y

Y

 

 

 

 

Allowing Public Registration
You may want to open your survey to the public, but utilise the sort of respondent control available when using tokens. If you initialise your tokens table, and have chosen to Allow Public Registration in the main survey setup, people who visit your survey's URL without a token, will be given the opportunity to register. If they provide an email address that is not already in the current survey's tokens table, an entry in the tokens table will be created, and they will be emailed an invitation containing their unique Token. All tokens provided to "registering" visitors will begin with the letter "R".

License

This program is opensource software under the terms of the GNU General Public License.