Skip to main content

Table 3 Usability analysis: effectiveness

From: Evaluating security and usability of profile based challenge questions authentication in online examinations

Question themes

Effectiveness and accuracy

  

Equality algorithm

Relaxed algorithm1

Academic questions

N2

Matched

Unmatched

Matched

Unmatched

Student number

1

1(100%)

0(0%)

1(100%)

0(0%)

Year started the current course

3

3(100%)

0(0%)

3(100%)

0(0%)

Year of highest qualification

4

3(75%)

1(25%)

3(75%)

1(25%)

Highest qualification

4

3(75%)

1(25%)

4(100%)

0(0%)

Find out about this course

3

2(67%)

1(33%)

2(67%)

1(33%)

Name of last school attended

5

3(60%)

2(40%)

4(80%)

1(20%)

Grades in highest qualification

2

0(0%)

2(100%)

0(0%)

2(100%)

Month started the current course

1

0(0%)

1(100%)

1(100%)

0(0%)

Total

15(65%)

8(35%)

18(78%)

5(22%)

Personal questions

Best friend’s surname

6

6(100%)

0(0%)

6(100%)

0(0%)

Country of birth

4

4(100%)

0(0%)

4(100%)

0(0%)

Father’s surname

3

2(67%)

1(33%)

3(100%)

0(0%)

Dream job as a child

2

1(50%)

1(50%)

2(100%)

0(0%)

Total

13(87%)

2(13%)

15(100%)

0(0%)

Favourite questions

Tutor

6

1(17%)

5(83%)

5(83%)

1(17%)

Hero of your childhood?

3

3(100%)

0(0%)

3(100%)

0(0%)

Module on this course?

3

0(0%)

3(100%)

0(0%)

3(100%)

Total

4(33%)

8(67%)

8(67%)

4(33%)

Contact questions

Home Tel no with country code

2

1(50%)

1(50%)

1(50%)

1(50%)

Home address town

4

1(25%)

3(75%)

2(50%)

2(50%)

House name or number

4

0(0%)

4(100%)

1(25%)

3(75%)

Mobile number including country code

1

0(0%)

1(100%)

0(0%)

1(100%)

Total

2(18%)

9(82%)

4(36%)

7(64%)

Date questions

Date of birth?

5

4(80%)

1(20%)

5(100%)

0(0%)

Grand total

66

38(58%)

28(42%)

50(76%)

16(24%)

  1. 1Disregard capitalization, whitespace and minor spelling errors.
  2. 2Number of challenge questions.
  3. Data in bold-face show an increase in effectiveness when results were computed using a relaxed algorithm.