Project Aria

Project Aria is a pioneering research program from Meta's Reality Labs, dedicated to responsibly building the future of augmented reality and artificial intelligence. It is not a consumer product but a comprehensive research platform designed to help researchers understand and overcome the complex challenges in developing future AR glasses and contextual AI systems. The core of the project is the Aria glasses, a sophisticated wearable device equipped with a state-of-the-art sensor suite for capturing data from a first-person (egocentric) perspective. This platform is made available to Meta's internal researchers and a global community of academic and corporate partners through the Aria Research Kit (ARK).

How to use Project Aria

Access to the Project Aria platform is intended for the research community and is not available for public purchase. The process to get involved is as follows:

1. Explore Open Resources: Before applying, potential partners are encouraged to explore Project Aria's publicly available resources. This includes extensive open-source datasets (like Nymeria and the Digital Twin Catalog), models, and tools (like the Aria Training and Evaluation toolkit - ATEK). This helps researchers understand the data and capabilities of the platform.
2. Develop a Research Proposal: Formulate a clear and novel research plan that leverages the unique capabilities of the Aria glasses and ecosystem. Successful applications typically address key challenges in computer vision, contextual AI, robotics, or machine perception.
3. Apply for the Aria Research Kit (ARK): Interested academic institutions and corporate research organizations can submit an application through the Project Aria website. Applications are reviewed on a rolling basis.
4. Conduct Research: Once approved, partners receive the ARK, which includes the Aria Gen 2 glasses, a comprehensive SDK, and support services to begin their research efforts.

Core Features of Project Aria

• Aria Gen 2 Glasses: The centerpiece of the project, these advanced research glasses feature a powerful sensor suite including 4 SLAM cameras, 1 RGB camera, 2 eye-tracking cameras, an IMU, barometer, magnetometer, and GNSS. They also include PPG sensors for physiological data, a contact microphone, on-device compute capabilities, and an extended battery life of 6-8 hours.
• Aria Research Kit (ARK): A complete package for researchers containing the Aria glasses, a full-featured Software Development Kit (SDK), and a suite of tools for data management, processing, and analysis.
• Extensive Open Datasets: Project Aria provides large-scale, high-quality datasets to the community, such as 'Reading Recognition in the Wild' for eye-tracking research, 'Nymeria' for human motion prediction, and the 'Digital Twin Catalog' for 3D object reconstruction.
• Open Source Tools and Models: The platform includes powerful tools like the Aria Training and Evaluation toolkit (ATEK) for building and evaluating deep learning models, and the Aria Dataset Explorer (ADE) for visualizing and downloading data. It also supports integration with popular frameworks like Nerfstudio.
• Collaborative Research Ecosystem: The project fosters a vibrant community of over 200 partners, encouraging open-sourcing of tools and datasets developed using the platform, such as HD-Epic and EgoLife.

Use Cases for Project Aria

Project Aria is being used to drive innovation across multiple domains:

• Contextual AI and Machine Perception: Developing AI that can understand a user's context, environment, and intent to provide timely and relevant assistance.
• Robotics: Enabling robots to learn complex tasks by observing human demonstrations from a first-person perspective, as seen in Georgia Tech's EgoMimic project.
• Augmented Reality (AR): Building the foundational technologies for future all-day wearable AR glasses, including scene understanding, 3D reconstruction, and user interaction models.
• Accessibility: Partnering with organizations like Envision AI to create technologies that empower blind and low-vision individuals by providing them with access to visual information.
• Automotive Industry: Collaborating with partners like BMW to research how AR technology can be integrated into future vehicles to enhance driver awareness and experience.

Advantages of Project Aria

The primary advantage of Project Aria is its role as a research accelerator. It provides researchers with a purpose-built, non-commercial hardware and software platform that is years ahead of consumer technology. This allows the community to tackle fundamental research problems without the costly overhead of building custom sensor rigs. The focus on open resources and collaboration creates a powerful flywheel effect, where community contributions build upon each other, advancing the entire field of egocentric AI and AR more rapidly.

Pricing and Plans

Project Aria is a research program, not a commercial product. Therefore, it does not have traditional pricing or plans. Access to the Aria Gen 2 glasses and the full suite of tools is provided through the Aria Research Kit (ARK). This kit is available to select academic and corporate research partners who successfully apply to the program. The selection is based on the merit and novelty of the proposed research. There is no cost specified for participation, as it is a collaborative research partnership.