Relative Content

Tag Archive for prometheusopenai-apilarge-language-modelpromql

Prometheous Query on llms total tokens

Openai llm models gives us the information of how many tokens are consumed, we want to use this data to get how many tokens are consumed in given period of time. So have implemented custom metrics where tokens is set as counter and is sent to Prometheus.
Now i want to know is counter good suitable for this. and what query should i us so that i can get total tokens consumed in given time range.
Currently i have used below query