Today, Vantage announces the general availability of OpenAI cost support in the Vantage console. Vantage customers can now see their overall OpenAI costs alongside their other infrastructure providers. Customers can add any number of OpenAI organizations from their integrations page, and Vantage will automatically ingest and visualize the various model costs accordingly.
Vantage first launched an integration with OpenAI in Beta in April 2023. At this time, OpenAI’s Usage endpoint was not publicly documented, and Vantage reconstructed cost data using OpenAI’s available pricing information. With the recent release of OpenAI’s new Costs endpoint, Vantage has updated this integration for full native support.
Now, with the general availability of OpenAI cost support, customers can grant Vantage access to their OpenAI cost data via an Admin Key, and Vantage will ingest and report on daily usage data for each OpenAI model. Filters in Vantage have been expanded to allow for Cost Reports to report on OpenAI costs with dimensions of a specific project, operation, model, and organization. Users can combine OpenAI costs with their other cost providers as well as receive notifications for costs and detected anomalies.
The OpenAI integration is now available to all customers. To connect your OpenAI account to Vantage, head to the Integrations page of account settings. You can read more about this integration in the OpenAI section of the Vantage documentation.
Frequently Asked Questions
1. What is being launched today?
Today, Vantage is announcing general availability of OpenAI cost support. Vantage customers can now provide Vantage with an OpenAI Admin Key, and costs will automatically begin to be ingested and visualized within Vantage from the corresponding organization. Vantage will refresh cost data from OpenAI on a daily basis to ensure data is always up-to-date.
2. Who is the customer?
This feature is available to all Vantage users, including users in the free tier, who also have an OpenAI account.
3. What is OpenAI?
OpenAI is an artificial intelligence research company. OpenAI’s research focuses on areas such as natural language processing, computer vision, and reinforcement learning. OpenAI provides AI services and tools to businesses and organizations, including language models, like GPT-4, which can generate human-like text.
3. How much does this cost?
There is no additional cost to OpenAI support. However, OpenAI costs will be included in quota tier enforcement. In the event that your OpenAI costs push you over your current tier limit you may be prompted to upgrade. To see more details on pricing, please refer to the pricing page.
4. How does Vantage technically integrate with OpenAI?
The Vantage integration uses an OpenAI Admin Key to access OpenAI’s Costs endpoint of the Usage API, which provides structured cost data broken down by operation (e.g., Chat Completion or Embedding) and model (e.g., GPT-3.5-turbo). Due to OpenAI requirements on accessing the Costs endpoint, this key must be an Admin Key. Only OpenAI Organization Owners can create Admin keys.
5. What permissions does Vantage have in my OpenAI account?
Vantage does not have the ability to perform any actions that incur costs. However, OpenAI requires an Admin Key to access the Usage APIs. This key includes additional permissions beyond what Vantage uses (see the full list of permissions here). Vantage only reads data from the Costs endpoint and will never perform any other actions.
All Admin Keys generated through OpenAI have revocable read-write access, and you can also enable audit logging if needed. Unfortunately, OpenAI does not currently support more fine-grained permissions for Admin Keys. We recommend customers submit a feature request to OpenAI for improved permission scoping, and Vantage will adopt fine-grained permissions if this becomes available.
6. What dimensions can OpenAI costs be filtered and grouped by?
OpenAI reports can support aggregating and filtering on the following dimensions:
- Service (i.e., Operations, such as “Chats and Completions”, “Images”, and “Embeddings”)
- Category (i.e., Models and operation-specific details, such as “gpt-4o”, “text-embedding-3-small”, and “assistants api”)
- Subcategory (i.e., Operation-specific metadata, such as “input”, output”, “cached input”)
- Billing Account / Organization
- Account / Project
7. What OpenAI services does Vantage support?
Vantage supports any services and models that are returned in the Costs endpoint.
8. Will this integration provide cost data on ChatGPT?
No, we only provide the cost data for your API usage on the operations we support (Completions, Chat Completions, Embeddings, etc.). ChatGPT is a separate product, unrelated to your Admin Keys, and because it doesn’t consume any of your organization’s API usage, it doesn’t incur costs and won’t show up in a Cost Report.
9. My costs don’t match my OpenAI portal. What should I do?
Please contact support@vantage.sh with relevant information from your OpenAI portal, such as screenshots of your total usage, daily usage, and credits.
10. How often does OpenAI data refresh in the Vantage console?
OpenAI data refreshes daily in the Vantage console.
11. What happens if I remove a OpenAI integration?
If you decide to remove your OpenAI integration from Vantage, all associated costs will be removed from the Vantage console associated with that OpenAI Admin Key.
12. Can I have multiple OpenAI organization integrations?
Yes, Vantage supports multiple OpenAI organization integrations.
13. Will OpenAI costs be represented in the Overview page?
Yes, OpenAI costs are represented in the Overview page and present in the “Provider Summary” widget.
14. Is there any additional documentation on this integration?
Yes. Additional information about the OpenAI integration can be found in the Vantage Documentation.
15. I’ve just added my OpenAI organization, how long will it take for my cost data to be present in the Vantage console?
Costs will be ingested and processed as soon as you add the integration. It usually takes less than 15 minutes to ingest OpenAI costs. As soon as they are processed they will be available on your “All Resources” Cost Report.
16. Will historical cost data for OpenAI be available?
Yes, when following the integration setup, you will be configuring 6 months of historical usage data from OpenAI.
17. What other cloud service providers is Vantage adding?
Vantage is planning on adding support for Cloudflare, ClickHouse, and Vercel. Please contact support@vantage.sh with other providers you’d like to see added.
