LLM evaluation suite for Doctor AI
A RAG-based evaluation framework that tests Ultrahuman's Doctor AI feature and catches regressions, hallucinations and drops in answer quality.
Ronit Roy
AI Engineer
I am an AI Engineer at Vialto Partners, where I set up harnesses, LLMs and evals. I came to it from test engineering, most recently as a Lead SDET building intelligent, self-healing automation ecosystems with LLM evaluation and RAG-based testing.
01projects
Selected work
Self-healing web and mobile automation
Web and mobile UI automation that uses AI and MCP to find elements and repair itself, reducing the maintenance that test suites normally need.
Player automation for live streaming at scale
Automation for video playback at Disney+ Hotstar across web, Android and iOS players, on the squad responsible for streaming quality for 28M+ concurrent users during peak live events.
End-to-end QA for Blood Vision
Quality engineering for an AI feature that reads blood test reports, from PDF ingestion, through AI analysis, to what the user sees in the app.
02about
About
03contact
Hiring, or want to work together?
Send a short message and I will get back to you.