IAT834 – Timeline

Winter 2017 Course Schedule

Week 1

Thurs Jan 5 2017

Room: SUR 2990

Topic

No Class meeting this week. You should start required readings and look at Assignment 1. Come prepared for class next week to talk about topics under Week 2.

Required Reading

Read: Creswell, J.W. Research Design: Qual, Quant, and Mixed Methods Approaches (2013, 4th edition) Chapter 1 [this is the core text for course].

Extra: Read Creswell & Clark’s Mixed Methods Research, (2007), Chapter 1 [library reserve].

If this is your second research methods course, this material should be a review.

If this is your first research methods course, you should do all the readings in both Creswell (2013) and Creswell & Clark (2007).

Week 2

Thurs Jan 12

Topic

[1] Introduction

Overview of course and course work.The course covers topics in epistemology, research design, design based research and mixed method approaches. It is intended as a second or third research methods course and readings will be geared to this level.

Text: Creswell, Research Design: Qualitative, Quantitative and Mixed Methods Approaches, Sage, 2013, fourth edition.

Recommended: Creswell & Clark, Designing and Conducting Mixed Methods Research, Sage, 2007. [on reserve]

Course Outline

[2] Concepts in Design-based Research

Discussion of terms: paradigm, epistemology, ontology, methodology etc.

[3] Research proposal assignment — 1. Defining your Research Topic.

Required Reading

Prepare for Class: Research topic — have one. A topic of study usually involves specification of people (who?), doing some activity (what?), with a form of interactive technology (more what?) in a context (where?). For example, “My topic investigates designing to support children living in poverty (who), learning to self-regulate their emotions (activity/what), using an EEG headset and simple mind-full games on an adroid tablet (tech/more what), at the Nepal House Kaski school in Nepal (where). That’s the level of detail you are after. Come to class with a print out of your first try at a topic specification like this.

Research paradigms in HCI: Steve Harrison, Phoebe Sengers, and Deborah Tatar. 2011. Making epistemological trouble: Third-paradigm HCI as successor scienceInteract. Comput. 23, 5 (September 2011), 385-392. DOI=10.1016/j.intcom.2011.03.005

Week 3

Thurs Jan 19

Topic

Paradigm Wars: Positivism vs. Constructivism and along came Pragmatism.

Measuring humans: Concepts, constructs and variables.

Research proposal — Assign 2. The Literature Review as a foundation for research design.

How to do an annotation.

Review assignment 1.

Required Reading

repare for Class: Answer — What is positivism? What is constructivism? What are the flaws of each paradigm wrt design research? How does pragmatism shore up? (hint: look beyond the readings). 1000 words max. Bring a print out.:

Read: Creswell, J.W. Research Design: Qual, Quant, and Mixed Methods Approaches (2013) Chapters 2 & 3

Extra: Read Creswell & Clark’s Mixed Methods Research, (2007), Chapter 2.

Assign 2 : Start to compile a list of key articles related to your research topic. Bring an article print out to class.

Week 4

Thurs Jan 26

Topic

No Class

Work on Assignment 3 [see below] and readings for next two weeks.

Required Reading

Next few weeks reading

Read: Creswell (2013) Chapter 4: Ethics sections only, Chapter 5: Introductions and Chapter 6: Purpose Statements.

Extra: Read Creswell & Clark’s Mixed Methods Research, (2007), Chapter 2.

Assign 2 : Start to compile a list of key articles related to your research topic. Bring an article print out to class.

Week 5

Thurs Feb 3

Topic

Logic: inference, deduction, induction

Strategies of Inquiry: Quant, Qual, Mixed and associated methodologies

Strategies of Inquiry in Design Research + history of the field

Check in assignment 2. Lit review peer review.

Research proposal — Assign 3. Introductions –> What’s the problem and why is it important? Examples.

Problem framing exercise.

Strategies of Inquiry check in.

Required Reading

There’s a lot to do for this class — start in advance!

Creswell (2013) Chapter 5: Introductions

Prepare for Class: Design research can fall under scientific, social science, humanities or art & design practice strategies of inquiry. How are each different? What are strengths and weakness of each? Which would you choose for your research topic and why. Bring a print out to class.

Prepare for Class: Be prepared to talk about the problem you will be studying and justify why it’s important.

Week 6

Thurs Feb 9

Topic

Ethics | What to consider

ORE Presentation

Purpose statement (This is part of Assign 3: Introductions posted above).

Assignment: Research proposal — 9. Ethical Issues in Data Collection [we’re doing this at this point in course b/c of ORE timing]

Required Reading

Read: Creswell (2013) Chapter 4: Ethics sections only

Read: Creswell (2013) Chapter 6.

Prepare for Class: Write a draft of your purpose statement. Bring print out to class. Be sure to include the justification for using a mixed methods design. Use the script from Creswell if that helps.

Week 7

Feb 16

Topic

Reading week — READ!!!!

How to create knowledge in design research:

READ: Fallman, Why research-oriented design isn’t design-oriented research. Proceedings of Nordes: Nordic Design Research Conference, Copenhagen, Denmark (2005).

Friedman, Creating design knowledge: from research into practice

Buchanan, Strategies of Inquiry in Design Research

For next lecture — Dix et alHuman Computer Interaction

Also Finish Creswell (2013) Chapter 1-6

Extra Read: Creswell & Clark’s Mixed Methods Research, (2007), Chapters 4, 5.

Required Reading

Read: Creswell (2013) Chapter 4: Ethics sections only

Read: Creswell (2013) Chapter 6.

Prepare for Class: Write a draft of your purpose statement. Bring print out to class. Be sure to include the justification for using a mixed methods design. Use the script from Creswell if that helps.

Week 8

Feb 23

Topic

Approaches to Design Evaluation

Research proposal — Assign 4. Research questions and hypotheses. (Part I)

.Continue to work on your critique of another student’s problem framing.

Required Reading

Prepare for Class: Write a draft of your quant and qual research questions (we’ll do mixed methods questions in two weeks in Part II). Bring print out to class.

Read: Creswell (2013) Chapters 4 (writing sections) and 7

If unfamiliar with evaluation methods for interfaces, read a section on interface design evaluation in any undergrad Interaction Design text:

  • Dix et alHuman Computer Interaction
  • Preece et al. Interaction Design
  • Stone et al. User Interface Design and Evaluation
  • Benyon, et al. Designing Interactive Systems

Extra: Read Creswell & Clark’s Mixed Methods Research, (2007), Chapter 3.

Week 9

March 2

Topic

Types of Mixed Methods Designs

Research proposal — 4. Research questions and hypotheses. (Part II)

Required Reading

Prepare for Class:Write a draft of your mixed methods research questions. Be sure to include the justification for using a mixed methods design.

Read: Creswell (2013) Chapters 8, 9 and 10.

Extra Read: Creswell & Clark’s Mixed Methods Research, (2007), Chapters 4, 5

Week 9

March 2

Topic

Types of Mixed Methods Designs

Research proposal — 4. Research questions and hypotheses. (Part II)

Required Reading

Prepare for Class:Write a draft of your mixed methods research questions. Be sure to include the justification for using a mixed methods design.

Read: Creswell (2013) Chapters 8, 9 and 10.

Extra Read: Creswell & Clark’s Mixed Methods Research, (2007), Chapters 4, 5

Week 10

March 9

Topic

Role of Theory in Design Research

Research proposal — 5. Role of Theory in Design Research.

Validity, Reliability & Triangulation in Design Research

Research proposal — 6.Definitions, (De)Limitations and Signficance.

Introduce presentations on empirical mixed methods design research study.

Required Reading

Presentation — submit preliminary paper choices. Work in pairs.

Read: Creswell (2013) Chapter 3.

Rogers, New Theoretical Approaches for HCI

Friedman, Theory construction in design
research: criteria: approaches, and
methods.

Morse et al. Verification strategies for establishing reliability and validity in qualitative researchInternational Journal of Qualitative Methods 1, 2, (2002).

Week 11

March 16

Topic

From empircal result to design knowledge — crossing the gap with rigor (vs leaping!)

Presentations: Deconstructing papers on empirical mixed methods design research + example paper Fan et al. 2017 Why Tangibility Matters: A Design Case Study of At-Risk Children Learning to Read and Spell, In Proceedings of Human Factors in Computing Systems (CHI 2017) ACM, in press.

Presentations: How to do a good presentation!

Quiz review.

Required Reading

Readings on design knowledge from READING WEEK.

Read example Fan et al CHI 2017 paper for presentation example.

Week 12

March 23

Topic

Remote Quiz 9:30 – 11:30 (by email).

No formal lecture.

Required Reading

No reading. Work on presentations and proposals.

Week 13

March 30

Topic

Data Collection Methods Overview

Research proposal — 7. Quant Data Collection

Research proposal — 8. Qual Data Collection

Video Coding (from qual to quant)

Required Reading

Finish Creswell (2013) all chapters.

Work on presentations and associated readings.

Note: papers will be emailed out. Please read for class next week.

Week 14

April 6

Topic

Case Analysis Presentations

Presentation guidelines and Grading Rubric

Case Analysis Presentations

This week we start analysis of mixed methods design research. One paper is presented by each pair of students as assigned/discussed with instruction. Here’s where the course should really come together for you and prepare you to finish your proposal.

Required Reading

Readings for ALL presentations

Week 15

April 13

Topic

Revised Research Proposal Due today at noon.

Hand in paper version to Antle mailbox in SIAT main office on Podium 2.

Required Reading

None