Our Mission

The Center for Augmented Cognition supports Berkeley faculty and students in their research on new computing paradigms and methodologies of human cognition modeling, human-computer interaction, and human-robot collaboration through augmented and virtual reality technologies.

Our Members

All Localization Imaging Immersion Interaction Applications Business Arts+Design Graphics
  • Ruzena Bajcsy


    Professor
    Department of EECS, UC Berkeley

  • Francesco Borrelli


    Associate Professor
    Department of Mechanical Engineering,
    UC Berkeley

  • Luisa Caldas


    Professor
    Department of Architecture,
    UC Berkeley

  • Lee Flemming


    Professor
    Department of Industrial Engineering
    UC Berkeley

  • Richard Koci Hernandez


    Assistant Professor
    Journalism, UC Berkeley

  • Shannon Jackson


    Associate Vice Chancellor
    Arts and Design, UC Berkeley

  • Jack McCauley


    Oculus Co-founder
    Jacobs Institute for Innovative Design

  • Ren Ng


    Assistant Professor
    Department of EECS, UC Berkeley
    Lytro Founder

  • James O'Brien


    Professor
    Department of EECS, UC Berkeley
    ACM SIGGRAPH Director at Large

  • S. Shankar Sastry


    Dean of the College of Engineering
    Professor of EECS

  • Claire J. Tomlin


    Professor
    Department of EECS, UC Berkeley

  • Allen Y. Yang


    Executive Director
    Center for Augmented Cognition
    Department of EECS, UC Berkeley

Our Projects

ISAACS

ISAACS is an open-source project to envision new ways for human users to intuitively interface and collaborate with aerial drones around augmented reality (AR) technologies.


ISAACS utilizes real-time SLAM solutions to localize the 3D coordinates of aerial vehicles and the operators wearing HoloLens. The first version of the platform will be developed in collaboration also with DJI based on the Matrice-100 platform.


Learn More

Teleimmersion

This research group is interested in computer vision, robotics, tele-immersive communications, and modeling of cyber-physical systems.


Our ongoing research activities entail human-robot cooperation, human activity recognition from multi-modal data, development of individualized musculoskeletal models, quantification of human performance, remote monitoring in health care and its privacy and security considerations, and modeling of driver interaction in semi-autonomous vehicles. Tele-immersion group is lead by Prof. Ruzena Bajcsy. The lab located in Sutardja Dai Hall, Room #133.


Learn More

Open Augmented Reality Kit (OpenARK)

OpenARK is an open-source wearable augmented reality (AR) system founded at UC Berkeley in 2016. The C++ based software offers innovative core functionalities to power a wide range of off-the-shelf AR components, including see-through glasses, depth cameras, and IMUs. The open-source platform includes fundamental tools such as AR-based camera calibration and SLAM, and it also includes higher-level functions to aid human-computer interaction, such as 3D gesture recognition and multi-user collaboration. We welcome interested industry partners to join our alliance to support the Open ARK platform.

Our Partners

Recent Updates

Berkeley AR/VR startup competition

Congratulations to the Pengram Team
for winning 1st place in this competition!

Pengram facilitates remote instruction of technical experts to technicians with complicated operations so as to enhance productivity and efficiency in enterprise collaboration. It displays intuitive operation instructions in the form of overlay holograms on real world machines through the Hololens. Technical experts can easily create a detailed live instruction animation without any coding in VR. For technicians, PenGram bridges the abysmal gap between the ambiguous traditional 2D paper based instructions and real world operation sequences.

Contact us

For more information and collaboration opportunities, please contact Executive Director Dr. Allen Y. Yang