Microsoft Member Technical Staff AI Pretraining Platform 

Taiwan, Taoyuan City 

891470864

training platform

pretraining platform to developwill spanthe boundaries of scale, performance, and

The AItraining Platformis responsible forall aspects of, kernel development, performance optimizations, communications, andfault tolerance

• infrastructure enablinglarge-scale AI model training

• Will thrive in a highly collaborative, fast-paced environment

• Have a high degree of craftsmanship and pay close attention to details

• Demonstrate a proactive attitude and enthusiasm for exploring new methods and technologies

• Effectively manage multiple responsibilities and can adjust to shifting priorities.

• Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field ANDexperience

• Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND experience in business analytics, data science, software development, or data engineering work

• OR equivalent experience.
• Experience with HPC (High performance computing) and/ or parallel programming.
• Experience in the area of pretraining
• Experience working with GPU clusters

• Design and developPython and CUDA/HIP C++codethatenable distributed trainingofmultimodalLLMs ingestingtext, audio, images,orvideodata.
• Build andmaintaincutting-edgeinfrastructure that can store and process thepetabytesof data needed to power models.
• Partner with the pretraining and post-training teams to improve our data recipe by rigorous and careful experimentation.
• Collaborate with the product team and other engineers and researchers across Microsoft AI toidentifygaps in the current generation of models.
• Embody ourand