Senior AI Engineer with Kubernetes
Job description
We are seeking a highly skilled Senior AI Engineer with strong expertise in Kubernetes and vector database technologies to join our team. In this role, you will design, build, and scale production-grade AI systems, working with cutting-edge LLM frameworks, embeddings, and cloud-native infrastructure to deliver robust and high-performance solutions. Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi. Responsibilities Deploy and manage Milvus vector databases, including schema design and index tuning (HNSW, IVF-FLAT) Build and maintain embedding and LLM pipelines using OpenAI API, Hugging Face, or Cohere Manage Kubernetes clusters, Helm charts, and containerized microservices in production Develop and maintain Docker containerization workflows, including multi-stage builds and registry management Design and deliver production-grade Python applications, integrating with Go, Java, or C++ where required Integrate object storage systems such as AWS S3, MinIO, or Google Cloud Storage Evaluate and implement alternative vector database solutions, including Qdrant, Pinecone, and Weaviate Collaborate cross-functionally with team members to deliver reliable, scalable AI services Ensure operational excellence, observability, and performance of deployed AI workloads Requirements Bachelor's degree in Engineering with 5+ years of relevant experience Expertise in Milvus deployment, schema design, and index tuning (HNSW, IVF-FLAT) Familiarity with vector database alternatives such as Qdrant, Pinecone, Weaviate, PGVector, or Chroma Proficiency in building embedding and LLM pipelines using OpenAI API, Hugging Face, or Cohere Skills in Kubernetes cluster management, Helm charts, and containerized microservices Background in Docker containerization, multi-stage builds, and registry management Production-level Python development along with Go, Java, or C++ Knowledge of object storage integration, including AWS S3, MinIO, or Google Cloud Storage Excellent verbal and written communication skills with strong team collaboration abilities Proficiency in English at an Upper-Intermediate level (B2) or higher Nice to have Experience supporting large-scale RAG applications and multi-agent platforms Hands-on familiarity with LangChain, LlamaIndex, or custom pipelines Understanding of GPU scheduling, resource optimization, and inference acceleration Production experience with hybrid search, metadata filtering, and index tuning Implementation of LLM evaluation, governance, tracing, and monitoring tools Familiarity with CI/CD pipelines, Infrastructure-as-Code, and cloud-native deployment practices Prior work experience in the Oil and Gas industry Experience with Dataiku DSS Knowledge of SRE practices We offer We connect like-minded people Delivering innovative solutions to industry leaders, making a global impact Enjoyable working environment, whether it is the vibrant office or the comfort of your own home Opportunity to work abroad for up to two months per year Relocation opportunities within our offices in 55+ countries Corporate and social events We invest in your growth Leadership development, career advising, soft skills and well-being programs Certifications, including GCP, Azure and AWS Unlimited access to LinkedIn Learning and Udemy Free English classes with certified teachers We cover it all Participation in the Employee Stock Purchase Plan Monetary bonuses for engaging in the referral program Comprehensive medical & family care package Five trust days per year (sick leave without a medical certificate) Benefits package (sports activities, a variety of stores and services) EPAM Georgia is a team of innovators united by a passion for technology. The dynamic and inclusive culture we embrace helps positively impact our communities, clients, and employees. Here you will collaborate with multi-national teams, contribute to numerous cutting-edge projects, deliver the most creative solutions, and have an opportunity to learn. Our people are at the heart of our success, and we are proud to provide talents with a solid ground to develop and grow.