Devanshu Chicholikar, Software Engineer, AI Engineer and Forward Deployed Engineer (MCP servers, RAG, evals, voice agents)
Open to Software Engineer, AI Engineer and Forward Deployed Engineer roles. Based in Boston, MA.
Hey! I ship AI systems to production end to end: MCP servers, RAG with retrieval evals, LLM-as-a-judge eval harnesses and voice agents, plus the full-stack, infra and design work around them. OpenCodeIntel is a code-search platform for AI coding agents (web app, API and MCP server), and Overhear grades every call a voice agent takes: code checks the call log, and an LLM judge checks what the agent said against the clinic's real open slots. MS Software Engineering Systems from Northeastern, finished May 2026.
Before that I spent two years full-time building a Java / Spring Boot quotation platform, and TA'd Network Structures & Cloud Computing for 100+ grad students across two semesters. Teaching set my bar: if I can't explain it at 11 PM to someone whose AWS setup is on fire, I don't understand it yet.
Projects
OpenCodeIntel: Code-search platform for AI coding agents: hybrid BM25 + vector retrieval with reranking, tree-sitter AST chunking, a web app, a REST API and a 12-tool MCP server.
Overhear: AI QA analyst for voice agents: grades every call a Retell scheduling agent takes. Code checks what the call log proves, and an LLM-as-a-judge checks what the agent said against the clinic's real slots.
CallBudget: Active-sensing pharmacy search: predict which pharmacy most likely has a hard-to-find drug, rank who a voice agent should call first, and learn from every answer. Tested on a simulated pharmacist with real pharmacy data.
Saar: Chrome extension that tracks Claude.ai token usage and cost in real time, entirely in the browser. Published on the Chrome Web Store.
Portfolio OS: A desktop operating system in a browser tab: window manager, terminal and dock, built from scratch.
saar CLI: Statically analyzes a codebase and generates agent context files (AGENTS.md, CLAUDE.md, .cursorrules). Published on PyPI.
Financial Copilot: AI expense tracker with automatic categorization, category budgets, spending insights and a daily safe-to-spend figure.
SecureScale: You know what's harder than writing code? Making sure it stays running in production. SecureScale is a fully automated AWS infrastructure setup designed to not break at 3 AM.
watsonx Test Forge: IBM watsonx Orchestrate hackathon. The problem: manually authoring Journey Success test cases for watsonx agents is tedious and error-prone. Test Forge is a multi-tool agent that reads deployed agent specs and generates validated test cases automatically.
Tool Crowding Benchmark: When an agent has dozens of MCP tools loaded, does it start picking the wrong one? Tool Crowding is a harness built to measure that cleanly, with the design and its hypotheses pre-registered before any data.
Mem Machines: Mem Machines is a serverless data ingestion pipeline built entirely on GCP: Cloud Run, Pub/Sub and Firestore working together on high-throughput data streams.
Campus Resources: A clean, searchable directory of campus resources built to help students navigate the overwhelming maze of university services, tools, and support systems.
Software Development Engineer Intern, Pitney Bowes, Jan 2022 - Jul 2022
Skills
AI-Assisted Development: Claude Code (subagents, hooks, custom skills), MCP server development, Agentic workflows, Spec-first development with AI agents, LLM evals, Cursor