Convai

Convai is a cutting-edge platform designed to empower developers and creators to build and deploy intelligent, conversational AI characters in virtual worlds, games, and extended reality (XR) applications. It provides a comprehensive suite of tools and APIs to craft non-player characters (NPCs) that are not just scripted entities but dynamic, spatially-aware beings capable of human-like interaction. By emulating human senses through its Character API, Convai processes vision, sound, and text inputs to generate realistic responses, animations, and complex actions, fundamentally changing how users engage with digital environments.

The platform is built on the belief that for AI to achieve a deep understanding, it must be embodied and possess spatial intelligence. Convai makes this possible through an intuitive, easy-to-use interface, robust infrastructure, and deep integrations with the most popular development environments. It aims to be the missing infrastructure layer that allows developers to harness the power of Large Language Models (LLMs) without getting bogged down by the complexities of latency, scaling, and cost management.

How to use Convai

Convai offers a streamlined workflow for both no-code creators and professional developers:

1. Craft the Character's Mind: Using Convai's web-based tools, you define your character's personality, backstory, role, and objectives. You can design custom narrative flows and populate a 'Knowledge Bank' with specific lore, product information, or any document to make the character an expert on a given topic. This minimizes AI 'hallucinations' and ensures contextually accurate conversations.
2. Embody The Mind Within An Avatar: Convai is avatar-agnostic, supporting major systems like Unreal Engine's MetaHumans and Reallusion avatars. You can choose from a vast set of pre-built animations or add custom ones. The platform handles high-quality, accurate lipsync and facial animations automatically to bring the character to life.
3. Deploy The Avatar In Your Environment: With deep integrations and plugins for game engines like Unreal Engine, Unity, and web platforms like PlayCanvas and Three.js, deploying your character is straightforward. Convai provides open APIs, SDKs, extensive documentation, and tutorials to facilitate a smooth integration process into your project, whether it's for a video game, a mobile app, a VR simulation, or a website.

Core Features of Convai

• Multimodal Interaction: Characters can perceive and react to their environment through vision (webcam or in-game POV), sound, and text, enabling truly interactive experiences.
• Role-playing and Narrative Design: Easily design characters with specific roles, goals, and conversational arcs that guide the user experience while allowing for open-ended dialogue.
• Knowledge Bank: Upload documents (e.g., game lore, product manuals, training materials) to provide your AI character with a specialized knowledge base for accurate and reliable responses.
• Complex Actions and Embodied Animations: Go beyond dialogue. Enable characters to perform a sequence of actions and animations based on conversational triggers, making them active participants in the virtual world.
• High-Quality Lipsync and Voices: Features accurate lip-syncing and a choice of over 500 voices across more than 65 languages to create believable and lifelike characters.
• Seamless Game Engine Integration: Offers dedicated plugins, SDKs, and comprehensive support for Unreal Engine, Unity, and other popular platforms.
• Scalable and Low-Latency Infrastructure: Built by ex-Google and ex-Nvidia engineers, the platform is optimized to handle millions of users with real-time, low-latency responses.

Use Cases for Convai

Convai's technology can be applied across various industries to create next-generation interactive experiences:

• Gaming and Social Virtual Worlds: Create intelligent NPCs that act as companions, quest-givers, or dynamic adversaries. These characters can onboard new users, enhance engagement, and create personalized, non-linear narratives that adapt to player actions.
• Learning and Training: Develop immersive role-playing simulators for corporate training, education, and upskilling. AI characters can act as mentors, customers, or trainees in realistic scenarios, providing interactive and engaging learning experiences.
• Brand Representatives: Deploy dynamic AI brand ambassadors on websites, in virtual stores, or at digital kiosks. These characters can engage customers 24/7, answer product queries, and provide a personalized and memorable brand interaction.

Advantages of Convai

Convai stands out by offering a developer-centric solution that is both powerful and accessible. Key advantages include its ease of use, which significantly reduces development time; its cost-effectiveness, bundling multiple AI services at a lower price point than sourcing them individually; and its commitment to innovation, constantly adding new features like long-term memory and scene-aware actions. The platform's robust, scalable infrastructure ensures reliability and low latency, making it suitable for projects of any size, from indie prototypes to large-scale enterprise applications.

Pricing and Plans

Convai offers a flexible pricing structure to suit different project needs and scales, including a free tier for experimentation.

• Free Plan: $0/month. Ideal for trials and proof-of-concepts, offering 100 interactions/month and basic tool access.
• Indie Dev Plan: $22/month (billed yearly). For individual creators starting a project, with 3,000 interactions/month, a larger knowledge bank, and access to more features.
• Professional Plan: $69/month (billed yearly). For developers ramping up, providing 10,000 interactions/month, increased concurrency, and more API requests.
• Scale Plan: $299/month (billed yearly). For teams and small-scale production, with 50,000 interactions/month, higher concurrency, and a larger user cap.
• Business Plan: $499/month (billed yearly). For large-scale production, offering 125,000 interactions/month and significantly higher limits across the board.
• Enterprise Plan: Custom pricing. Offers data ownership, on-premise deployment options, SLAs, and enhanced security for large organizations.

An 'interaction' is counted each time a user sends input and the AI character responds. Plans also have caps on the usage of flagship LLMs (like GPT-4o) and premium third-party voices.