LLMonitor is an open-source observability platform that provides cost and usage analytics, user tracking, tracing and evaluation tools.

​
Installation and Setup

Create an account on llmonitor.com, then copy your new app’s tracking id. Once you have it, set it as an environment variable by running: 
export LLMONITOR_APP_ID="..."

​
Callbacks

See a usage example. 
from langchain.callbacks import LLMonitorCallbackHandler