This 2024 case study describes how a UK ERP software company with 40+ years of history and 6M+ customers added a GenAI assistant to help SMB users instantly interpret financial reports. Brillio built a solution on Azure OpenAI that sends balance sheet and income statement data as JSON to an LLM through a FastAPI and LangChain web app, evaluates six key ratios, and returns strengths, weaknesses, and conclusions to support faster decisions. The design includes strict JSON validation, multilingual output (French, German, Spanish), caching via Cosmos DB using SHA-256 hashes to reuse prior responses, rate limiting for cost control and DDoS protection, and dual-model load balancing. Delivery used LLMOps with GitHub Actions and Terraform-based IaC for repeatable deployments, improving scalability

Join for free to read