For the complete documentation index, see llms.txt. This page is also available as Markdown.
Updated

Operate

Monitor costs, acquisition, analytics, and app health after launch.

Deploying a financial application is the first step, not the last. Once it's live, the priority shifts from development to governance, fiscal transparency, and scale. Operate is the administrative control tower for your ecosystem of AI-driven tools.

In a production banking environment, every interaction carries a cost and every user journey requires attribution.

For account-wide governance and monitoring, use the Control Center.

Usage and billing

The Usage & Billing dashboard gives a high-fidelity view of how AI resources are consumed across your digital ecosystem — from a single Commercial Loan Portal to a suite of internal Compliance Agents.

App build-time cost visibility. App build-time cost visibility has been added, so you know what you're spending before you even publish.

For account-wide credit usage, spending limits, and alerts, use Billing in Control Center.

Resource tracking

Live telemetry on credit and token consumption, rather than retrospective reporting.

  • Token-Level Visibility: Monitor LLM token usage across providers (e.g., Vertex AI, Claude) to understand the exact cost of each automated interaction.

  • Credit Management: Track platform credits in real time, whether you're on Pay-As-You-Go or a pre-allocated enterprise plan.

  • Automated Institutional Invoicing: Detailed invoices break usage down so you can reconcile expenses or re-allocate costs to departments or branch locations.

Auto-unpublish on Dev/QA environments after 5 hours

In line with our ongoing cost-control efforts, apps on Dev and QA environments will now auto-unpublish after 5 hours of inactivity.

Budget optimization

Attribute costs to specific business outcomes.

  • Identify High-Consumption Assets: See which apps or agents are most resource-intensive. If a Wealth Management Chatbot consumes more tokens than expected, refine its prompt or switch it to Flash Mode to improve unit economics.

  • Departmental Allocation: Attribute usage to business units, enabling charge-back models where Commercial Lending and Retail Banking are billed only for the AI logic they use.

  • Budget Guardrails: Set proactive alerts and thresholds so a pilot project stays within its quarterly budget — you're notified before usage hits critical levels.

Analytics and referrals

Understanding where a high-value lead came from is essential for optimizing marketing spend and managing partner relationships. Referral Tracking monitors user acquisition with granular precision.

For unified engagement data across published apps, use Observability in Control Center. For one app's traffic, use Analytics.

  • UTM-Based Referrals: Track which campaigns, emails, or digital ads convert into active users.

  • Partner Link Attribution: Assign unique referral codes to external partners — mortgage brokers, insurance agents, branch locations. When a user onboards via a partner link, the acquisition is permanently attributed to the correct source.

  • Conversion Insights: Identify which referral channels drive the highest quality applications by tracking the path from click to submitted loan application.

  • Performance Auditing: Review acquisition data to ensure marketing budget goes to the highest-performing channels.

  • Seamless Integration: Referral data is captured at the point of entry and can be passed into your CRM or internal reporting systems via the API Call or Mapper skills.

System health

Maintain visibility into platform stability and response times to ensure your deployment delivers the experience your brand promises.

For organization-wide dashboards across every app and agent, see Monitoring & Performance Dashboards under Governance. For a single agent's runtime behavior, see Monitor in the Agent Builder.

For account-wide activity, model calls, and API requests, use Logs & Data in Control Center.

Last updated