You can use this lesson in your class!
Introduction to Observer bias Lesson
Completed

Introduction to Observer bias Lesson

Introduction

Was this helpful?

(Voting helps us personalize your learning experience!)
Observer bias introduction: Over fitting
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Kappa statistic Introduction

Was this helpful?

(Voting helps us personalize your learning experience!)
Kappa statistic estimated distribution

Was this helpful?

(Voting helps us personalize your learning experience!)
Kappa statistic Hypothesis Test

Was this helpful?

(Voting helps us personalize your learning experience!)
Kappa experiment: minimum sample size

Was this helpful?

(Voting helps us personalize your learning experience!)
Conclusion and next steps

Was this helpful?

(Voting helps us personalize your learning experience!)
Probability of Chance agreement Theory
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
k by k frequency table example
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Calculating Kappa statistic in Python
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Kappa statistic Distribution
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Hypothesis Test for the Kappa statistic
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Review of statistical definitions
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Example
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Example output
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Example: critical region of the observed Kappa statistic
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Example: hypothesis test decision Python code
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Sample size
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Sample size claim
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Sample size derivation Proof: Part 1
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Sample size derivation Proof: Part 2
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Example: minimum sample size calculation
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Minimum sample size calculation: output
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Kappa statistic Type I and Type II error Normal curves
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)
Example: minimum sample size result
image resource

Was this helpful?

(Voting helps us personalize your learning experience!)