Recommendation Architecture AI/ML Infrastructure Engineer Intern (Data-Arch-TikTok Live) - 2027 Summer

Public source summary from intern-list.com / Jobright.

TikTok is a leading destination for short-form mobile video. The company is seeking an AI/ML Infrastructure Engineering Intern to build and optimize distributed training, inference, GPU computing, and LLM infrastructure for its large-scale recommendation systems.

Responsibilities

Build and optimize infrastructure for large-scale model training and online inference Develop distributed systems supporting large recommendation models and LLMs Improve training and inference performance through GPU optimization and efficient communication Collaborate with researchers to develop and deploy LLM training and serving solutions Analyze system bottlenecks and implement performance optimizations

Qualifications: Currently pursuing a Bachelor's or Master's degree in Artificial Intelligence, Software Development, Computer Science, Computer Engineering or a related technical discipline Strong programming skills in C++ or Python Good understanding of data structures, algorithms, and computer systems Familiarity with PyTorch or TensorFlow Knowledge of Transformer architectures and Large Language Models (LLMs) Strong problem-solving skills and a passion for building large-scale AI systems Hands-on experience with LLM training or inference through research, internships, or open-source projects Familiarity with distributed training concepts (e.g., DP, TP, PP, FSDP, ZeRO) Experience with GPU programming using CUDA, Triton, or similar technologies Understanding of LLM serving techniques such as KV Cache, Continuous Batching, or FlashAttention Contributions to open-source projects or research in machine learning systems, distributed systems, or LLM infrastructure

Benefits: Interns have day one access to health insurance, life insurance, wellbeing benefits and more. Interns also receive 10 paid holidays per year and paid sick time (56 hours if hired in first half of year, 40 if hired in second half of year). Interns who are not working 100% remote may also be eligible for housing allowance.