What's included?
You can edit this quickstart to add helpful components. View the repository and open a pull request.
Monitor your GPT-3 and GPT-4 Application Usage in New Relic
With the GPT integration, you'll have the ability to seamlessly monitor OpenAI completion queries and simultaneously log useful statistics in a New Relic customizable dashboard about your requests.
By adding just two lines of code, users can gain access to key performance metrics such as cost, response time, and sample inputs/outputs. The dashboard also allows users to track total requests, average token/requests, and model names.
With New Relic's fully customizable dashboard, users can add additional metrics based on their specific business requirements and needs.
Overall, New Relic's OpenAI integration provides real-time metrics around GPT applications to help businesses optimize usage, reduce costs, and achieve better results.