Our Mission

The Center for Augmented Cognition supports Berkeley faculty and students in their research on new computing paradigms and methodologies of human cognition modeling, human-computer interaction, and human-robot collaboration through augmented and virtual reality technologies.

Our Members

All Localization Imaging Immersion Interaction Applications Business Arts+Design
  • Ruzena Bajcsy

    Department of EECS, UC Berkeley

  • Francesco Borrelli

    Associate Professor
    Department of Mechanical Engineering,
    UC Berkeley

  • Luisa Caldas

    Department of Architecture,
    UC Berkeley

  • Lee Flemming

    Department of Industrial Engineering
    UC Berkeley

  • Richard Koci Hernandez

    Assistant Professor
    Journalism, UC Berkeley

  • Shannon Jackson

    Associate Vice Chancellor
    Arts and Design, UC Berkeley

  • Jack McCauley

    Oculus Co-founder
    Jacobs Institute for Innovative Design

  • Ren Ng

    Assistant Professor
    Department of EECS, UC Berkeley
    Lytro Founder

  • S. Shankar Sastry

    Dean of the College of Engineering
    Professor of EECS

  • Claire J. Tomlin

    Department of EECS, UC Berkeley

  • Allen Y. Yang

    Executive Director
    Center for Augmented Cognition
    Department of EECS, UC Berkeley

Our Projects


ISAACS is an open-source project to envision new ways for human users to intuitively interface and collaborate with aerial drones around augmented reality (AR) technologies.

ISAACS utilizes real-time SLAM solutions to localize the 3D coordinates of aerial vehicles and the operators wearing HoloLens. The first version of the platform will be developed in collaboration also with DJI based on the Matrice-100 platform.

Learn More


This research group is interested in computer vision, robotics, tele-immersive communications, and modeling of cyber-physical systems.

Our ongoing research activities entail human-robot cooperation, human activity recognition from multi-modal data, development of individualized musculoskeletal models, quantification of human performance, remote monitoring in health care and its privacy and security considerations, and modeling of driver interaction in semi-autonomous vehicles. Tele-immersion group is lead by Prof. Ruzena Bajcsy. The lab located in Sutardja Dai Hall, Room #133.

Learn More

Open Augmented Reality Kit (OpenARK)

OpenARK is an open-source wearable augmented reality (AR) system founded at UC Berkeley in 2016. The C++ based software offers innovative core functionalities to power a wide range of off-the-shelf AR components, including see-through glasses, depth cameras, and IMUs. The open-source platform includes fundamental tools such as AR-based camera calibration and SLAM, and it also includes higher-level functions to aid human-computer interaction, such as 3D gesture recognition and multi-user collaboration. We welcome interested industry partners to join our alliance to support the Open ARK platform.

Our Partners

Recent Updates

Berkeley Symposium Virtual and Augmented Reality and Applications (VARA)

October 6th, 2016
Banatao Auditorium, Sutardja Dai Hall


  • Berkeley Augmented Telemedicine (Room 133): Ruzena Bajcsy, Gregorij Kurillo, Allen Yang
  • Dynamic SLAM: Oladapo Afolabi, Alex Mai, Shankar Sastry, and Allen Yang
  • ISAACS: Vicenc Rubies Royo, Claire Tomlin, Shankar Sastry, Allen Yang,
  • ActiveVR:BlueGoji,Inc.
  • A Remote Expert System Built upon a Telepresens Robot and WebRTC (Lobby): Siemens
  • AR with Tango: Google Tango Team
  • Campanile VR: Berkeley VR Club
  • MEMS-Based Real-Time Localization: Jack McCauley
  • Cardboard VR Textbook Project: Berkeley VR Club

Organizing Committee

Ruzena Bajcsy, CITRIS, UC Berkeley
Lee Fleming, Faculty Director, Coleman Fung Institute for Engineering Leadership, UC Berkeley
Coleman Fung, Blue Goji, Inc.
Bjoern Hartmann, Interim Director, Jacobs Institute for Design Innovation
Shannon Jackson, Associate Vice Chancellor, Director of Arts Research Center and Arts and Design Initiative, UC Berkeley
Robert Knight, Psychology, UC Berkeley
Gregorij Kurillo, CITRIS, UC Berkeley
Jack McCauley, Jacobs Institute for Design Innovation
Lisa Wymore, Chair, Department of Theater, Dance, and Performance Studies, UC Berkeley
S. Shankar Sastry, Dean, College of Engineering, UC Berkeley
Ikhlaq Sidhu, Director, Sutardja Center for Entrepreneurship & Technology
Claire Tomlin, CITRIS, UC Berkeley
Allen Y. Yang, Executive Director, Center for Augmented Cognition, UC Berkeley

Contact us

For more information and collaboration opportunities, please contact Executive Director Dr. Allen Y. Yang