September 6, 2001
After hand coding the data logs of 6 students from our intensive field test in MV, I developed specifications for batch processing the mass of data logs collected in the various implementations. Ed Burke and I negotiated what was possible given the state of the data logs, and Ed wrote the necessary program to process them. The table below presents the results of statistical analysis of the processed logs. I've organized them by implementation because both the activities and the extent of data logging varied.
The implementations (MR, MV, L, and C) are in chronological order. As you scan the table you get an idea of when activities were added and when data logging for particular activities was implemented. You can also tell which activities do not yet include essay questions: Meiosis, Monohybrid, Dihybrid, Sex-Linkage, Scales, Plates, and Invisible Dragons.
For each implementation you'll find the number of logs generated and the number of valid logs. Valid logs are those logs that have a date and a total time greater than 0. Invalid logs arise from bugs in the program or aborted launches.
For each activity, you'll find the number of data logs analyzed to produce the numbers that follow.
This table is an intermediate research result. It is intended as a display of data that will provoke questions. We invite you peruse the table and generate your own questions.
What the production of this table demonstrates is that we can automatically process at least some of the data from the data logs which in turn can be incorporated into a report for teachers and students. Because students logged in under a variety of names, we cannot at this point correlate specific logs with specific students. When we have implemented a structured log in procedure, we will be able to generate a class roster for the teacher that includes which activities students have completed, how long they took and a rough indicator of engagement; current candidates are Index of Interaction and Words per Answer. Student reports will include the questions encountered and answers entered.
Activity |
MR |
MV |
L |
C |
Logs generated(N) Valid Logs (N) |
54 31 |
438 319 |
2128 1566 |
214 201 |
Introduction Number of data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
5 2 min -- 2 11 |
39 16 min 2.0 6 9 |
273 20 min 1.63 3 8 |
28 23 min 1.4 18 5 |
Rules Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
7 3 min .16 5 5 |
36 19 min .52 16 3 |
266 12 min .36 2 0 |
35 11 min .46 2 2 |
Meiosis Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
None generated. |
18 12 min 1.0 0 0 |
283 9 min .60 0 0 |
38 9 min 1 0 0 |
Inheritance Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
3 2 min 1 1 8 |
19 3 min 2.0 1 14 |
130 7 min 2.88 1 7 |
20 8 min 3.33 1 2 |
Monohybrid Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
None generated. |
26 16 min .23 0 0 |
204 12 min .36 0 0 |
20 11 min .37 0 0 |
Mutations Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
11 6 min 1.3 1 0 |
33 8 min 1.17 3 2 |
98 6 min 1 3 2 |
15 6 min .7 3 2 |
Mystery Trait Number - data logs |
None generated. |
Replaced by scales |
||
Mutations 2 Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
absent |
27 16 min .62 2 7 |
36 10 min .65 1 6 |
3 21 min .75 1 8 |
Horns Dilemma Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
absent |
25 7 min .38 12 4 |
32 5 min .24 12 4 |
9 5 min .27 6 3 |
Dihybrid Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
absent |
26 15 min .83 0 0 |
26 11 min .52 0 0 |
7 25 min 2.5 0 0 |
Sex-Linkage Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
None generated. |
20 33 min 1.18 0 0 |
52 7 min .62 0 0 |
5 13 min 1 0 0 |
Scales Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
5 12 1.7 0 0 |
22 13 min .28 0 0 |
35 10 min .19 0 0 |
2 4 min .19 0 0 |
Plates Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
absent |
28 1.5 min .08 0 0 |
25 2 min .18 0 0 |
5 6 min 1 0 0 |
Invisible Dragons Number - data logs Total time (median) Index of Interaction(median) # Questions(median) Words/answer (median) |
absent |
None generated. |
None generated. |
14 3 min .73 0 0 |