Machine Learning Engineer
JSC National Information Technologies
Jan 2025 — Jun 2026Built production RAG and LLM serving systems, including semantic search and evaluation; reported 40% faster query resolution and 15% better answer relevance.
• Designed and deployed RAG pipelines integrating corporate data with LLMs, reducing query resolution time by ~40%. • Configured inference servers (Ollama, vLLM) handling 500+ concurrent requests with sub-second latency. • Integrated PostgreSQL + pgvector for semantic search across 100K+ documents. • Built retrieval evaluation frameworks (precision@k, MRR), improving answer relevance by 15%. • Designed whole flow of chat-bot with differnt pipelines, including: llm guardrails, intent routing, chat history with chat context window with Redis.
