What's wrong with this: "I want to see whether I can improve the pace of my lessons by talking less or having shorter activities so I will do both in the next three lessons and measure the pace of the lesson."
Two variables are in play so we will not know which one had the effect.
We can't measure pace in a lesson.
Talking less will not affect the pace.
Nothing.
Hypotheses should be:
disprovable.
ambitious.
variable.
based on the data we collect.
Conclusions should be:
disprovable.
based on the hypotheses.
tentative.
ones which show causality.
I want to find out what my learners think about the coursebook so I'll do:
a descriptive survey.
an analytic survey.
an experiment.
a set of tests.
I want to see if a two Dogme lessons a week reduces my learners' inhibitions concerning speaking in front of the whole class so I'll run:
a descriptive survey.
an analytic survey.
an experiment.
a test.
I want to make sure that all four reading texts I am using in this experiment are at the same level of difficulty so I'll:
put the texts through a word processor and get a Flesch reading ease figure.
count the words in each sentence to make sure they are roughly the same length.
analyse the word class percentages in the text.
make sure there are the same number of active and passive voice clauses in each text.
I tried a new technique for a listening text and my class performed much better on a comprehension test than they usually do. This shows:
that the new technique definitely worked.
that something has caused a change.
that trying new things always helps.
that it's a good technique for all listening lessons.
post hoc ergo propter hoc means:
after this therefore because of this.
after a change we have an effect.
all changes have effects.
small changes may have large effects.
Comparing learners' answers to questions such as Does this activity help you to learn better? may be unsuccessful because:
the question requires people to guess.
the question asks for insight into a personal cognitive processes.
learners will always say Yes.
learners never know what helps them learn.
What's wrong with asking: Did this lesson help you? Please tick Yes, No, or Maybe.
We won't know how little or how much it helped.
Students will always say Yes.
Students will always tick Maybe.
The scale is wrong.
Qualitative data are sometimes useful to:
find out exactly what our learners think so we can make changes.
set the agenda for a proper descriptive or analytic survey.
determine whether our hypothesis was correct.
make judgements about the success of an experiment.
If we use a before-and-after technique in an analytical survey of a group then we are conducting:
a survey with a separate control group.
a survey which uses the group itself as a control.
a survey which will not tell us what changed.
a synchronous survey.
It is important to make a scale consistent in terms of what we want to measure being positive (scoring better than the mean) or negative (scoring below the mean) because:
not doing this makes the analysis very difficult.
we need to have clear questions for people to answer.
we have to give people the option to pick the middle ground.
we want to measure things.
We should avoid terms like difficult or interesting in Yes-No-response questions because:
they are gradable.
they are vague.
they are routinely misunderstood.
we can't measure the outcomes.
Presenting results diagrammatically is often helpful because: