Senior/Software Engineer, AI-Powered Advertising Agents

About the Role PubMatic is looking for engineers with expertise in Generative AI and AI agent development. You will be responsible for building and optimizing advanced AI agents that leverage the latest technologies in Retrieval-Augmented Generation (RAG), vector databases, and large language models (LLMs). You will work on developing state-of-the-art solutions that enhance Generative AI capabilities and enable our platform to handle complex information retrieval, contextual generation, and adaptive interactions. What You'll Do: Provide technical leadership and mentorship to engineering teams while collaborating with architects, product managers, and UX designers to create innovative AI solutions that address complex customer challenges. Lead the design, development, and deployment of AI-driven features. Drive end-to-end ownership—from feasibility analysis and design specifications to execution and release—while ensuring quick iterations based on customer feedback in a fast-paced Agile environment. Spearhead technical design meetings and produce detailed design documents that outline scalable, secure, and robust AI architectures. Ensure that the solutions are aligned with long-term product strategy and technical roadmaps. Implement and optimize LLMs for specific use cases, including fine-tuning models, deploying pre-trained models, and evaluating their performance. Develop AI agents powered by RAG systems, integrating external knowledge sources to improve the accuracy and relevance of generated content. Design, implement, and optimize vector databases (e.g., FAISS, Pinecone, Weaviate) for efficient and scalable vector search, and work on various vector indexing algorithms. Create sophisticated prompts and fine-tune them to improve the performance of LLMs in generating precise and contextually relevant responses. Utilize evaluation frameworks and metrics (e.g., Evals) to assess and improve the performance of generative models and AI systems. Work with data scientists, engineers, and product teams to integrate AI-driven capabilities into customer-facing products and internal tools. Stay up to date with the latest research and trends in LLMs, RAG, and generative AI technologies to drive innovation in the company’s offerings. Continuously monitor and optimize models to improve their performance, scalability, and cost efficiency.