Skip to main content

Table 3 Usability analysis: effectiveness

From: Evaluating security and usability of profile based challenge questions authentication in online examinations

Question themes Effectiveness and accuracy
   Equality algorithm Relaxed algorithm1
Academic questions N2 Matched Unmatched Matched Unmatched
Student number 1 1(100%) 0(0%) 1(100%) 0(0%)
Year started the current course 3 3(100%) 0(0%) 3(100%) 0(0%)
Year of highest qualification 4 3(75%) 1(25%) 3(75%) 1(25%)
Highest qualification 4 3(75%) 1(25%) 4(100%) 0(0%)
Find out about this course 3 2(67%) 1(33%) 2(67%) 1(33%)
Name of last school attended 5 3(60%) 2(40%) 4(80%) 1(20%)
Grades in highest qualification 2 0(0%) 2(100%) 0(0%) 2(100%)
Month started the current course 1 0(0%) 1(100%) 1(100%) 0(0%)
Total 15(65%) 8(35%) 18(78%) 5(22%)
Personal questions
Best friend’s surname 6 6(100%) 0(0%) 6(100%) 0(0%)
Country of birth 4 4(100%) 0(0%) 4(100%) 0(0%)
Father’s surname 3 2(67%) 1(33%) 3(100%) 0(0%)
Dream job as a child 2 1(50%) 1(50%) 2(100%) 0(0%)
Total 13(87%) 2(13%) 15(100%) 0(0%)
Favourite questions
Tutor 6 1(17%) 5(83%) 5(83%) 1(17%)
Hero of your childhood? 3 3(100%) 0(0%) 3(100%) 0(0%)
Module on this course? 3 0(0%) 3(100%) 0(0%) 3(100%)
Total 4(33%) 8(67%) 8(67%) 4(33%)
Contact questions
Home Tel no with country code 2 1(50%) 1(50%) 1(50%) 1(50%)
Home address town 4 1(25%) 3(75%) 2(50%) 2(50%)
House name or number 4 0(0%) 4(100%) 1(25%) 3(75%)
Mobile number including country code 1 0(0%) 1(100%) 0(0%) 1(100%)
Total 2(18%) 9(82%) 4(36%) 7(64%)
Date questions
Date of birth? 5 4(80%) 1(20%) 5(100%) 0(0%)
Grand total 66 38(58%) 28(42%) 50(76%) 16(24%)
  1. 1Disregard capitalization, whitespace and minor spelling errors.
  2. 2Number of challenge questions.
  3. Data in bold-face show an increase in effectiveness when results were computed using a relaxed algorithm.