TAIPEI- — At Computex 2024, NVIDIA showcases Project G-Assist, an RTX-powered AI assistant technology demo that provides context-aware help for PC games and apps.
PC games offer vast universes to explore and intricate mechanics to challenge even the most dedicated gamer. Many spend hours scouring the internet for assistance to learn and master their favorite titles. The amount of knowledge available is immense, spanning millions of guides and countless words.
Project G-Assist aims to put game and system knowledge at players’ fingertips. Simply ask a question about your game or system performance, and the AI assistant provides context-aware answers.
How Gaming AI Assistants Work
Project G-Assist takes voice or text inputs from the player, along with a snapshot of what’s in the game window. The snapshot is fed into AI vision models that provide context awareness and app-specific understanding for the Large Language Model (LLM), which is connected to a database of game knowledge such as a wiki. The output of the LLM is an insightful and personalized response—either text, or speech from the AI —based on what’s happening in-game.
G-Assist’s vision and language models can be customized by developers for a specific game or app, providing a high degree of accuracy and insightfulness.
These custom AI models can then be run on the cloud, or are locally accelerated by GeForce RTX AI PCs and laptops.
