Sys 6023 - Cognitive Systems Engineering, Spring, 2016

Class Times/Location: Tuesdays & Thursdays 5:00 - 6:15pm, Rice 032

Office Hours: By email, phone, or appointment

Instructor: Stephanie Guerlain, (434) 242-7292, OLS 118b, guerlain@virginia.edu

Teaching Assistant: Loi Huynh, (404) 579-9663 ldh3jf@virginia.edu

Course Website: On UVa Collab

Course Objectives: This course introduces the fundamentals for the analysis, design and evaluation of human-centered systems in both “simple” contexts such as a single user working with a product under no time constraints or severe consequences and “complex” domains that involve teamwork, competing objectives, time pressure, high risk, and/or supervisory control. Course topics include analysis of human-systems interaction, domain and task analysis, software and product user interface design, usability testing, experimental design, and human-centered lifecycle design. Course projects and assignments include examples from medical, military, transportation, consumer product, and process control domains.

What fundamental questions will this course help you answer? What are the human information processing fundamentals to understand for designing and evaluating human-systems interactions?  What methods can I use to analyze a human/systems interaction?  What theories explain the kinds of errors people make?  How can we design systems, products and software to reduce the likelihood of human error and improve ease of use and overall improved system functioning? What are alternative decision support system approaches?  How do I design and conduct an effective human-centered system evaluation?  What are the advantages and disadvantages of the different usability evaluation methods?  What are some different approaches to designing decision support systems?  What effects can these designs have on performance? 

Required Readings:

Norman, D. (1993). The Design of Everyday Things. New York: Doubleday (The original editions (1988 and 2002) are OK to use as well as the latest version published in 2013).

Additional Readings (on Collab) as indicated.

Recommended Readings:

Hutchins, E. (1995).  Cognition in the Wild. Cambridge, MA: MIT Press.

Tufte, E. (1990). Envisioning Information. Cheshire, CT: Graphics Press.

And see attached list of references....

 

 COURSE MODULES:

1. Introduction
2. Human Information Processing
3. How Artifact Design Affects Complexity
4. Human-Centered System Design
5. Decision Support Systems

Grading:

Attendance and Class Participation 15%

Quizzes and Assignments 85%

 

LIST OF COGNITIVE SYSTEMS ENGINEERING CONCEPTS

 

The effects of automation on performance

Supervisory Control

Human-computer cooperative problem solving

Clumsy Automation

Trust

Situation Awareness

Decision Aiding Systems

Directions vs. Maps

Representation Aiding

         Affordances, Salience, Mapping

Consultant Systems

Critiquing Systems

Computer Supported Cooperative Work

Naturalistic Decision Making

Skills-Rules-Knowledge

Abstraction Hierarchy

Decision Ladder

Mental Models

Recognition-Primed Decisions

Knowledge-based expert systems

Team performance

Domain characteristics and constraints

Expert-novice differences

         chunking

Strategies

Heuristic Reasoning

Decision Biases

Problem-solving as search through a problem-space

Use of tools

Cognitive Task Analysis

Cognitive Work Analysis

Knowledge Acquisition

Information Flow

Communication Paths

Tools used

Constraints

Distributed cognition - "knowledge in the head" and "knowledge in the world".

Field studies and observation

Disturbance Management

Alarm Management

Latent Errors

Human Error

Usability Testing

Problem Types

Problem Solving

Information Retrieval

Diagnosis

Planning

Scheduling

Resource Allocation

Domains

Aviation, Driving, Trains, Dispatching, Emergency Management, Health Care, Process Control, Military Command and Control, Sports

Design

Human-Centered System Design

Work Domain and Task Analysis

Mental Models

Requirements' Gathering

Prototyping

Usability Testing

Design of Experiments

Verbal Protocol Analysis

Behavioral Protocol Analysis

Speed-Accuracy Tradeoff

Signal Detection

Physical and Mental Workload

 

References

Burns, C. (2000). Putting it all together:  Improving display integration in ecological displays. Human Factors, 42(2), 226-241.

Card, S., Moran, T., & Newell, A. (Eds.). (1983). The Psychology of Human-Computer Interaction. Hillsdale, NJ: Laurence Erlbaum Associates.

Guerlain, S. (2000). Interactive advisory systems. Human Performance, Situation Awareness and Automation: User-Centered Design for the New Millennium, Savannah, GA, 166-171.

Guerlain, S., & Bullemer, P. (1996). User-initiated notification:  A concept for aiding the monitoring activities of process control operators. Proceedings of the 1996 Annual Meeting of the Human Factors and Ergonomics Society, Philadelphia, PA, 283-287.

Guerlain, S., Jamieson, G. A., Bullemer, P., & Blair, R. (2002). The MPC Elucidator: A case study in the design for human-automation interaction. IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans, 32(1), 25-40.

Guerlain, S., Shin, T., Guo, H., & Calland, J. F. (2002). A team performance data capture and analysis system. Proceedings of the Human Factors and Ergonomics Society 46th Annual Meeting, Baltimore, MD, 1443-1448.

Guerlain, S., Smith, P., Obradovich, J., Rudmann, S., Strohm, P. Smith, J. Svirbely, J. and Sachs, L. (1999). Interactive critiquing as a form of decision support: An empirical evaluation. Human Factors. 41(1), pp. 72-89.

Hutchins, E. (1995).  Cognition in the Wild. Cambridge, MA: MIT Press.

Layton, C., Smith, P., and McCoy, E. (1994). Design of a cooperative problem-solving system for enroute flight planning:  An empirical evaluation. Human Factors. 36, pp. 94-119.

Mandel, T. (1997). The Elements of User Interface Design. New York: John Wiley & Sons, Inc.

McNeese, M., Salas, E., and Endsley, M. (2001). New Trends in Cooperative Activities: Understanding System Dynamics in Complex Environments.  Santa Monica, CA: Human Factors and Ergonomics Society.

Montgomery, D. C. (1991). Design and Analysis of Experiments, Third Edition. New York: John Wiley & Sons.

Nielson, J. (1993). Usability Engineering. San Francisco, CA: Morgan Kaufmann Publishers, Inc.

Norman, D. (1990). The Design of Everyday Things. New York: Doubleday. (Originally published as The Psychology of Everyday Things. New York: Basic Books, 1988).

Norman, D. (1993). Things That Make Us Smart. Reading, MA: Perseus Books.

Parasuraman, R., Mouloua, M. (1996). Automation and Human Performance. Theory and Applications. Mahwah, NJ: Lawrence Erlbaum Associates.

Rasmussen, J. (1986) Information processing and human-machine interaction: An approach to cognitive engineering.  Amsterdam: North Holland.

Rasmussen, J., Pejtersen, A., and Goodstein, L. (1994) Cognitive Systems Engineering.  New York, NY: John Wiley and Sons.

Reason, J. (1990). Human Error. New York: Cambridge University Press.

Santoro, T., Laxar, K., and Luria, S. (1994).  Vision and displays.  Making the most of parallel processing, Ergonomics in Design, January, pp. 10-15.

Shneiderman, B. (1998). Designing the User Interface: Strategies for Effective Human-Computer Interaction. Third Edition. Reading, MA: Addison-Wesley.

  Simon, H. (1981). The Sciences of the Artificial (2^nd ed). Cambridge, MA: MIT Press.

Stanton, Human factors in alarm design. Taylor and Francis

  Tufte, E. (1990). Envisioning Information. Cheshire, CT: Graphics Press.

Vicente, K. (1999). Cognitive Work Analysis. Mahwah, NJ: Lawrence Erlbaum Associates.

Vicente, K. (2004). The Human Factor. Revolutionizing the Way People Live with Technology. Mahwah, NJ: Lawrence Erlbaum Associates.

Wickens, C. and Hollands, J. (2000). Engineering Psychology and Human Performance, Third Edition. New York: Routledge.

Wickens, C., Gordon, S., and Liu, Y. (1998). An Introduction to Human Factors Engineering. New York: Addison Wesley Longman.

Williams, R. (1987). The Non-Designer’s Design Book. Design and Typographical Principles for the Visual Novice. Berkeley, CA: Peachpit Press.

Woods, D. (1991). The Theory and Practice of Representation Design in the Computer Medium. CSEL Technical Report: The Ohio State University, Columbus, OH.

   Zhang, J. and Norman, D. (1994). Representations in distributed cognitive tasks. Cognitive Science, (18), pp. 87-122.