Advanced Research and Evaluation Methods

From WikEd

Jump to: navigation, search

TEP 261 wiki-Syllabus: co-created by Jim Levin and the members of the third year cohort of TEP Ed.D. students at UCSD

Sept 29 Oct 6 Oct 13 Oct 20 Oct 27 Nov 3 Nov 10 Nov 17 Nov 24 Dec 1

Week 1: Sept 29

Introduction

To do before next week:

  • skim through the textbook you adopted and add the list of topics you'd like to cover to the syllabus possibilities list
  • review your Second year paper and any feedback you got, and bring in thoughts about a revised version - also post them on the revised white paper page (be sure to sign your name to your posting)
  • bring in a simple outline of your dissertation proposal and note where parts of your Second year paper might fit - also post them on the dissertation proposal page
  • read Virginia Richardson's essay on the nature of the education doctorate - post your reactions, especially the implications of this essay to the Ed.D. in Teaching & Learning on the Ed.d. page

Week 2: Oct 6

Proposal writing

Your Second year papers:

Dissertation committees:

Your dissertation outlines:

Doctoral study & the TEP Ed.D.

For next week: focus on research design:

  • read more closely the randomized experimental design chapter of your "adopted" textbook
  • select some research issue that you care about that could be addressed with a randomized experimental design and describe the design on the randomized experimental design page
  • send me an email message with your preferences for your doctoral committee, as described on the Ed.D. in T&L dissertation committees page

Week 3: Oct 13

A list of syllabus possibilities

  • Co-constructing a syllabus (as a part of constructivist learning)
  • Sharing time / sharing activities - add youself to the syllabus whenever you want to share

Research design

  • What is research design?
  • What are randomized experimental designs?
    • What is random?
    • a simple way to carry out random selection with the =RAND() function and the Sort tool in Excel
    • A website that creates random integers
    • randomization and generalization: population -> sample -> population
  • Between-subjects vs. within-subjects designs
  • Factorial designs
  • Counter-balancing
  • When to use which design?
    • Threats to internal validity
    • Threats to external validity
  • Ethics of randomized experimental design
  • The politics of research design: Methodology wars IES vs. NSF vs. Shavelson & Towne vs. ...
  • How does science learn? Applying learning theories to scientific knowledge building
  • Dissertation committees: the next steps

For next week:

  • read the chapter in your textbook on "quasi-experimental designs"
  • send me (if you haven't ready) an email with a list of at least five people (beyond your advisor) that you'd like to have on your dissertation committee, along with reasons why
  • design and post in the quasi-experimental design page a quasi-experiment that you might carry out

Week 4: Oct 20

Quasi-experimental design

  • grad student liaison role for junior search: who?
  • Here is a link to the UCSD IRB website. The forms we need are under the Social and Behavioral Sciences Forms heading. Chris
  • Nov 17th presentations by the MA/First year Ed.D. students?
  • Specifics on the need for human subjects forms (question from Heather)
  • Possible class discussion ideas (Luz)
    • Where are we in our overall dissertation process? i.e. Have we found a setting? Have found our focus of study? Do we know what we are trying to accomplish with our research?
      • How could we support each other in this matter?
      • What sort of help would we need at this point?
      • What would be useful for each one of us at this point?
      • What are the next steps we should be taking?
      • How should our final project look like for this class?


  • Paired reviews of dissertation proposals


For next week:

  1. Design a survey on some topic of interest and post it on our survey page
  2. Compare two surveys of the presidental race (look at pollingreport.com for instance) that differ substantially in their predictions, and comment on why they vary on our presidental survey page
  3. Skim through the funding possibilities and comment on which you think would be most valuable for TEP on the funding page
  4. Bring a list of 4-6 research questions that you hope to address in your dissertation if you are interested in exchanging your list with another classmate for feedback. (Melissa)

Week 5: Oct 27

Survey Methods, & Mixed Methods

Resources for graduate students

Proposals:

  • FIPSE: The Use of Annotated Video by Study Groups to Improve Teacher Education
  • ITEST: TeachITweb: A system for Teacher-Driven Integration of Information Technologies

Time to talk about dissertation research questions and relevant methodology--Kim

Time to check out the lunar eclipse real quick at 7:20?--Pam :)

  • Random assignment vs. random selection
  • Literary Digest: 2.4 million sample out of 128 million population
    • 1936 prediction: Landon 57% Roosevelt 43%
    • Result: Roosevelt 62% (27,751,597) Landon 38% (16,679,583)
  • current polls: ~1000 out of 293,027,571 (July 2004 est.) population
  • Simple random selection vs. stratified random selection vs. area probability sampling
  • Population -> sample -> population

For next week:

  1. Read the "descriptive statistics" chapter of your textbook
  2. Find or create some simple data set you care about and bring it in next time so we can compute descriptive statistics on it (if you don't already have it in an Excel spreadsheet, type it or paste it into the first column of this Excel worksheet (below the "Data" header cell)

Week 6: Nov 3

What courses are available/out there for the Winter quarter? (Chris)

Introduction to data analysis: Descriptive statistics

This website has some examples of central tendency, and a really cool histogram which you can modify to visually see the mean, mode, median and skew (Luz).

HyperStat Online

Nice set of applets illustrating various statistical concepts Jim

Week 7: Nov 10

Timelines for preparing, submitting and revising Human Subjects applications for all the different organizations that will be involved in our research. (Luz)
UCSD's Human Subjects protection site

Let me know what is your preferred TEPwiki login (for next quarter)

New browser: Firefox 1.0 for Mac and Windows

Correlational statistics

For next week:

  • Read your textbook's chapter on hypothesis testing
  • Run some of the tests on your own data

Week 8: Nov 17

Hypothesis testing statistics

News on committee formation: outside members have to be tenured UC faculty not on the TEP Ed.D. faculty list

When do we use t-tests, z-tests, one-tailed, two-tailed? What do the numbers generated by these tests mean? (Luz)

This website contains tons of information on Statistics (Luz).

Interactive Statistical Calculation Pages

First year Ed.D. & MA student reports in Claire's class

Week 9: Nov 24

Research design choices

Week 10: Dec 1

Summary

  • Course evaluation
  • 15 minute time slots
Retrieved from "http://wik.ed.uiuc.edu/index.php/Advanced_Research_and_Evaluation_Methods"
Personal tools