llm-logprob-demo
An interactive Streamlit app that visualises token-level log probabilities from Azure OpenAI (Azure AI Foundry). Built as an educational tool to help explain how Large Language Models generate text.
An interactive Streamlit app that visualises token-level log probabilities from Azure OpenAI (Azure AI Foundry).
Built as an educational tool to help explain how Large Language Models generate text.
Good for Demos and explanations about LLM
Peek under the hood of your favorite large language models with this playful app that breaks down text generation token by token, showing you exactly how confident the AI is at every step. It’s like giving your prompts a colorful confidence report card that’s as fun as it is enlightening!
Key features:
- 🎨 Visualizes token-level log probabilities with vibrant confidence colors
- 🔍 Interactive tables and expanders reveal alternative token choices
- 📊 Dynamic Plotly bar charts map out token probabilities across responses
- 🤖 Supports both OpenAI and Azure OpenAI chat models seamlessly
This summary was generated by GitHub Copilot based on the project README.