Custom Character Integration

Custom characters are integrated through the cloud UE renderer package. The browser does not receive facial animation frames or run a local character rig.

React Integration

import { useAStackCSR } from '@aether-stack-dev/client-sdk/react';

function MyApp({ session }) {
  const { rendererPlayerUrl, connect, startCall, stopCall } = useAStackCSR({
    session,
  });

  return (
    <>
      {rendererPlayerUrl && (
        <iframe title="AStack renderer" src={rendererPlayerUrl} />
      )}
      <button onClick={() => connect().then(() => startCall())}>
        Start Call
      </button>
      <button onClick={stopCall}>Stop Call</button>
    </>
  );
}

Data Flow

Browser sends microphone, text, and optional image input to the gateway.
Worker runs ASR, LLM, TTS, and Runtime MetaHuman Lip Sync.
Worker forwards response audio and motion directly to UE.
UE returns audio and video to the browser over WebRTC.