Smart Information Flow Technologies - playbook

A Human-System Interface with Contingency Planning for Collaborative Operations of Unmanned Aerial Vehicles

jhamell — Mon, 15 May 2017 18:53:21 +0000

The U.S. military is researching capabilities for collaborative and highly autonomous unmanned aircraft systems to conduct missions in denied or contested airspace, where multiple teams of aircraft would work together under the supervision of a single operator. One of the key challenges in this paradigm is the need for an effective human-system interface (HSI): one that could provide sufficiently detailed command and control authority and monitoring of plan execution for the entire system without overwhelming the operator. Another interesting challenge is the need to proactively find and approve multiple contingency plans, effectively granting the highly autonomous agents more freedom to operate when communication to the human supervisor is denied. This paper describes our recent efforts to design and develop a combined human-system interface and contingency planning tool that addresses these challenges. We present the design of our SuperC3DE system, provide examples of how certain interface components and contingency planning methods would be used in a notional scenario, and discuss key takeaways from formative evaluations by subject matter experts.

Citation:

Joseph B. Mueller, Christopher Miller, Ugur Kuter, Jeff Rye, and Josh Hamell. "A Human-System Interface with Contingency Planning for Collaborative Operations of Unmanned Aerial Vehicles", AIAA Information Systems-AIAA Infotech @ Aerospace, AIAA SciTech Forum, (AIAA 2017-1296)

Date Published:

Monday, January 9, 2017

Publication File:

sc-scitech-2017-vfin-reduced.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

Delegation in LoA3 Space

admin — Fri, 31 Jul 2015 20:26:59 +0000

Citation:

Funk, H. and Miller, C. (2008). Delegation in LoA3 Space. (Tech. Rep SIFT TR 08-LOA3-01). Minneapolis: Smart Information Flow Technologies.

Date Published:

Wednesday, October 22, 2008

Publication File:

SIFT TR 08-LOA3-01.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

Designing For Flexible Interaction Between Humans and Automation: Delegation Interfaces for Superviory Control

admin — Fri, 31 Jul 2015 19:40:54 +0000

Keywords: automation extremes, LOA, playbook, APC

Abstract: Objective: To develop a method enabling human-like, flexible supervisory control via delegation to automation. Background: Real-time supervisory relationships with automation are rarely as flexible as human task delegation to other humans. Flexibility in human-adaptable automation can provide important benefits, including improved situation awareness, more accurate automation usage, more balanced mental workload, increased user acceptance, and improved overall performance. Method: We review problems with static and adaptive (as opposed to “adaptable”) automation; contrast these approaches with human-human task delegation, which can mitigate many of the problems; and revise the concept of a “level of automation” as a pattern of task-based roles and authorizations. We argue that delegation requires a shared hierarchical task model between supervisor and subordinates, used to delegate tasks at various levels, and offer instruction on performing them. A prototype implementation called Playbook® is described. Results: On the basis of these analyses, we propose methods for supporting human-machine delegation interactions that parallel human-human delegation in important respects. We develop an architecture for machine-based delegation systems based on the metaphor of a sports team’s “playbook.” Finally, we describe a prototype implementation of this architecture, with an accompanying user interface and usage scenario, for mission planning for uninhabited air vehicles. Conclusion: Delegation offers a viable method for flexible, multilevel human-automation interaction to enhance system performance while maintaining user workload at a manageable level. Application: Most applications of adaptive automation (aviation, air traffic control, robotics, process control, etc.) are potential avenues for the adaptable, delegation approach we advocate. We present an extended example for uninhabited air vehicle mission planning.

Citation:

Miller, C., & Parasuraman, R. (2007) Designing For Flexible Interaction Between Humans and Automation: Delegation Interfaces for Supervisory Control. Human Factors, 49(1), 57-75.

Date Published:

Thursday, February 1, 2007

Publication File:

MP-HumanFactors-2007.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

A Playbook™ for Real-time, Closed-Loop Control

admin — Wed, 29 Jul 2015 19:58:23 +0000

Keywords: delegation interfaces, tasking interfaces, unmanned air vehicles, robotics, hierarchical task networks, mixed initiative control, discrete event control

Abstract: SIFT has been developing an approach to adaptable automation control of multiple Unmanned Air Vehicles (UAVs) we call a PlaybookTM because it is based on the metaphor of a sports team’s book of acceptable plays. Playbook represents a “delegation” approach to human-automation interactions because it allows a human operator to task or delegate authority to automation with much of the same flexibility with which a human supervisor or team captain can delegate objectives, methods, constraints and even detailed instructions to subordinates. In previous work, we have described the Playbook architecture and approach, illustrated interfaces, presented initial data clarifying its benefits and describing collaborative interactions with it. Here, we review the Playbook concept and previous work and then report on newly implemented play capabilities including the ability for the Playbook to coordinate the activities of multiple UAVs to track a groundbased moving target—a play that requires Playbook to dynamically replan within authority delegated to it by the human operator.

Citation:

Funk, H., Goldman, R., Miller, C., Meisner, J., & Wu, P. (2005, March). A Playbook™ for Real-time, Closed-Loop Control. Submitted for inclusion in Proceedings of the 1st Annual Conference on Human-Robot Interaction. Salt Lake City, UT.

Date Published:

Tuesday, March 1, 2005

Publication File:

FGMMW-HRI05.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

Optimizing to Satisfice: Using Optimization to Guide Users

admin — Wed, 29 Jul 2015 19:53:36 +0000

Keywords: playbook, unmanned aerial vehicle, delegation interfaces, overconstrained missions

Abstract: We describe a delegation-based solution to the planning overconstrainedUAV missions. SIFT’s PlaybookTM approach to UAV control allows single operators to request services from multiple-UAV teams, without excessive workload, specialized training, or platform-specific ground control systems. We use the metaphor of a sports team’s playbook: a user “calls a play” for a mission, relying on the system to flesh out the details. As in a sports playbook, the user has the freedom to add specifics at will. We have integrated Playbook with Geneva Aerospace’s VACS system ground station, to control multiple, heterogeneous, rotorcraft and fixed-wing UAVs. Using PVACS, we have discovered that overconstrained missions are particularly challenging, because it is difficult for operators find appropriate ways to relax constraints. To solve this problem we have added a “best-effort” planning mode to the Playbook. Best-effort plans may be directly useful, or can be used as a guideline in relaxing constraints.

Citation:

Goldman, R., Miller, C., Wu, P., Funk, H. & Meisner, J. (2005, January 18-20). Optimizing to Satisfice: Using Optimization to Guide Users. Proceedings of the American Helicopter Society’s International Specialists Meeting on Unmanned Aerial Vehicles. Chandler, AZ.

Date Published:

Tuesday, January 18, 2005

Publication File:

AHSismur05.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

The Playbook Approach to Adaptive Automation

admin — Wed, 29 Jul 2015 19:33:05 +0000

Keywords: playbook, supervisory control, unmanned aerial vehicle, play templates, adaptive automation, relaxed planning

Abstract: SIFT has pioneered a human-automation integration architecture, called PlaybookTM, based on a shared model of the tasks in the domain. This shared task model provides a means of human-automation communication about plans, goals, methods and resource usage—a process akin to referencing plays in a sports team’s playbook. The Playbook enables human operators to interact with subordinate systems with the same flexibility as with well-trained human subordinates, thus allowing for adaptive automation. We describe this approach and its application in an ongoing project called Playbook-enhanced Variable Autonomy Control SystemTM (P-VACS).

Citation:

Miller, C., Funk, H., Wu, P., Goldman, R., Meisner, J., & Chapman, M. The Playbook Approach to Adaptive Automation. Proceedings of the Human Factors and Ergonomics Society's 49th Annual Meeting, Orlando, FL.

Date Published:

Thursday, September 1, 2005

Publication File:

MFWGMC-HFES2005.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

A Flexible Delegation-Type Interface Enhances System Performance in Human Supervision of Multiple Robots: Empirical Studies with RoboFlag

admin — Wed, 29 Jul 2015 19:29:29 +0000

Keywords: automation, delegation, human–robot interaction, playbook, unmanned vehicles

Abstract: Three experiments and a computational analysis were conducted to investigate the effects of a delegation-type interface on human supervision of simulated multiple unmanned vehicles. Participants supervised up to eight robots using automated behaviors (“plays”), manual (waypoint) control, or both to capture the flag of an opponent with an equal number of robots, using a simple form of a delegation-type interface, Playbook. Experiment 1 showed that the delegation interface increased mission success rate and reduced mission completion time when the opponent “posture” was unpredictably offensive or defensive. Experiment 2 showed that performance was superior when operators could flexibly use both automated behaviors and manual control, although there was a small increase in subjective workload. Experiment 3 investigated additional dimensions of flexibility by comparing delegation interfaces to restricted interfaces. Eight interfaces were tested, varying in the level of abstraction at which robot behavior could be tasked and the level of aggregation (single or multiple robots) to which plays could be assigned. Performance was superior with flexible interfaces for four robots, but this benefit was eliminated when eight robots had to be supervised. Finally, a computational analysis using task-network modeling and Monte Carlo simulation gave results that closely paralleled the empirical data on changes in workload across interface type. The results provide initial empirical evidence for the efficacy of delegation-type interfaces in human supervision of a team of multiple autonomous robots.

Citation:

Parasuraman, R., Galster, S., Squire, P., Furukawa, H. & Miller, C.(2005). A Flexible Delegation-Type Interface Enhances System Performance in Human Supervision of Multiple Robots: Empirical Studies with RoboFlag. IEEE Systems, Man and Cybernetics-Part A, Special Issue on Human-Robot Interactions, 35(4), 481-493.

Date Published:

Friday, July 1, 2005

Publication File:

ParasuramanIEEE2005.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

Using Delegation as an Architecture for Adaptive Automation

admin — Wed, 29 Jul 2015 19:07:09 +0000

This document describes an approach to using a delegation framework, such as that provided by SIFT’s Playbook, as a structure for coordinating, managing and organizing experiments on Adaptive Automation and “Levels of Automation”—that is, as an Adaptive Automation Architecture (AAA). We use a very simple Overfly play as an example. In our discussion, we show how over 400 different possible human-automation interaction configurations can be obtained, even with just this simple play.

Citation:

Miller, C., Goldman, R. and Funk, H. (2005). Using Delegation as an Architecture for Adaptive Automation. (Tech. Rep. SIFT-TR 05-TUSC-01). Minneapolis: Smart Information Flow Technologies.

Date Published:

Monday, October 3, 2005

Publication File:

SIFT TR 05-TUSC-01.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

A “Playbook” for Variable Autonomy Control of Multiple, Heterogeneous Unmanned Air Vehicles

admin — Wed, 29 Jul 2015 18:52:39 +0000

Citation:

Miller, C., Funk, H., Goldman, R. & Wu, P. (2004, March 22-25) A “Playbook” for Variable Autonomy Control of Multiple, Heterogeneous Unmanned Air Vehicles. Paper presented at the 4th Conference on Human Performance, Situation Awareness and Automation, Daytona Beach, FL.

Date Published:

Monday, March 22, 2004

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages:

A Playbook Approach to Variable Autonomy Control: Application for Control of Multiple, Heterogeneous Unmanned Air Vehicles

admin — Wed, 29 Jul 2015 18:50:55 +0000

Keywords: PVACS, VACS, unmanned aerial vehicles, overwatch

Abstract: As Unmanned Air Vehicles (UAVs) become more common, several core challenges emerge including the need for single operators to control, or perhaps more accurately, to request services from, multiple UAVs without the degree of workload, specialized training and platform-specific control interfaces which characteristize of current UAV operation. A challenging problem involves the dismounted, small unit soldier who may need services from a range of vehicles while in challenging situations such as urban combat. We are developing an approach to UAV control that addresses these challenges. We use the metaphor of a sports team’s playbook to enable both quick and complex, variable-initiative control of a variety of UAVs—the user of our Playbook “calls a play” which need not (but may, if the user desires) specify what type or how many UAVs should be used to satisfy it. We describe the Playbook-enhanced Variable Autonomy Control System (PVACS), which combines SIFT’s Playbook architecture and Geneva Aerospace’s Variable Autonomy Control System (VACS). We illustrate the capabilities and operations of PVACS in an extended walkthrough example involving a request for Overwatch—continued surveillance—of an urban intersection and the development and execution of a plan to satisfy that request using multiple, heterogeneous UAVs.

Citation:

Miller, C., Goldman, R., Funk, H., Wu, P. & Pate, B. (2004, June 7-10). A Playbook Approach to Variable Autonomy Control: Application for Control of Multiple, Heterogeneous Unmanned Air Vehicles. Paper presented in FORUM 60, the Annual Meeting of the American Helicopter Society, Baltimore, MD.

Date Published:

Monday, June 7, 2004

Publication File:

MGFWP-AHS04-fin.pdf

Workflow: Editor Role:

Request Review

Workflow: Publisher Role:

Publish

Prevent Workflow Messages: