Scoring Options

  Previous topic Next topic JavaScript is required for the print function Mail us feedback on this topic! Mail us feedback on this topic!  



Set Scoring Options screen


Many stations have their own preference for song scoring options.  Some use a scale of 1-5 (good to bad), others use 1-5 (bad to good), and others use a simple 1 (good) 2 (OK) 3 (bad), with alternate options to capture unfamiliarity or burn.


When determining your station's score attributes, the best rule of thumb is K.I.S.S.... Keep It Simple, Stupid.  Even though listeners will be writing down the scoring options prior to taking the test, it will still make it easier for them if their top of mind response directly corresponds to a score you have selected.  Most people's responses to songs are along the lines of Hate It, Love It, Tired Of It, Never Heard It, etc.  But if you have cryptic options such as It's OK if I'm at work but when I'm In the car I don't like it, you will only serve to confuse the respondent and taint the results of your testing.  Keep it simple.


You are given 11 basic response ranges (more than enough to choose from).  Determine which of these (perhaps 5, 6 or 7 of them) you will use.  The goal is not to use all 11 ranges; just the ones that are important to you.  These score attributes will be used in processing the reports and browses that you run in ComQuest.  While they can be changed at any time, keep in mind that the meaning of all previously captured scores would then also change.


For example, if you've been using 6 to mean Tired Of It, and you decide to change 6 to mean Never Heard It, all songs that respondents previously scored a 6 (Tired) will now be shown to represent Never Heard Of It.


In the number box for each appropriate attribute, select the touch tone response that you want to correspond to the response.  You should use the same wording when writing the Scoring Scripts and the prompts to be recorded on the Fileserver, so the score that is given by the respondent correctly matches the intended response.


The Weight Factor allows you to skew the results depending upon scores.  For example, say you use 4 for Like Some and 5 for Favorite.  You might assign a weight of 1.0 for the 4's but give a weight of 1.5 or even 2.0 for the 5's.  This will effectively increase the count of 5's by whatever factor you've designated.  Respondents that gave a song a 5 will literally carry more weight, and add to the overall positive score for that song.


On the other hand, you can achieve a similar result with negative scores.  If 1 means Hate It and 2 means Dislike It Some, you might wish to weight the 1's, so they count more strongly against the net dislike score in your reports.


Keep in mind, if you weight any scores over 1.0, it is possible that some reports will show values over 100%.  This is because some respondent's scores now count as more than just one vote, and if you get enough of these weighted scores, the total could very well be over 100%.  Likewise, if you have any scores weighted below 1.0, it's unlikely that you will see any reports at or near 100%.


HandAny of the Dislike options (the first four choices), or the Positive options (the bottom cluster of four) that you use must also have a Weight Factor.


While you can't weight Tired or Unfamiliar, you must assign a Weight Factor (default is 1.0) to any of the other scoring options that you choose to use.


When you click OK to save your Scoring Options, the options that have a value under the Score column will be accepted as valid touch tone input during the Interactive song test.  Any numbers (1-9) that are not included under the Score column will not be accepted by the system during the music test.


HandIf you change any of your scoring options, you must also change the associated Interviewer Scripts, as well the recorded prompts on your Fileserver that refer to the scoring options.


Discrete Burn Option


ComQuest can collect two scores for each song you test.  Most stations prefer to fold the burn option into the other options.  For example, "Rank the song on a scale of 1-5, press 6 if you're tired of the song, or 7 if you don't know it..." This way, respondents only have to make one selection for each song.


However, if you want to collect a discrete score for burn, you can do that with ComQuest.  In this case, respondents would first score the song.  For example, "Rank the song on a scale of 1-5, or press 7 if you don't know it..." Then, they would be prompted for a second score, such as, "Now, if you hear the song too much, press 1, if you hear it just the right amount, press 2, or if you don't hear it enough press 3".  This will collect a second, discrete burn score for each song.  Note that this burn prompt must play after each respondent submits their initial rating for each and every song.  Also, if you're testing 30 songs for example, the respondent now has to submit 60 scores, instead of 30 (you've doubled the amount of data entry most respondents must submit to complete a test). Keep this in mind in case you elect to utilize the second burn score option; your conversion of Take Tests (qualified respondents) to Completes will most likely drop with the increased data entry necessary from each respondent to finish the test.


When using the discrete burn option, you should add 20 to the burn option which indicates the respondent is tired of the song.  In the example in the previous paragraph, we used 1 to indicate they were tired of the song, so you would put "21" in the field to the left of Tired on the Scoring Options screen.


See also

Interviewer Scripts

Recording Songs And Questions