Why work at WebXT

Inside Microsoft's Web Experiences Team

Are you interested in developing and optimizing deep learning systems? Are you interested in designing novel technology to accelerate their training and serving for cutting edge models and applications? Do you want to scale large AI models to their limits on massive supercomputers? Are you interested in being part of an exciting open-source library for deep learning systems? The DeepSpeed team is hiring!

DeepSpeed (http://deepspeed.ai) is an open-source library built on the PyTorch ecosystem that combines numerous research innovations and technology advancements to make deep learning efficient and easier to use. DeepSpeed can parallelize across thousands of GPUs and train models with trillions of parameters. DeepSpeed is used across industry and academia, and it powered the training of the record-

breaking MT-NLG language model with 530 billion parameters. The DeepSpeed team is also part of the larger Microsoft AI at Scale initiative, which is pioneering the next-generation AI capabilities that are scaled across the company’s products and AI platforms.

The DeepSpeed team is looking for researchers and research managers with passion for innovations and for building high-quality systems that will make significant impact inside and outside of Microsoft. Our team is highly collaborative, innovative, and end-user obsessed. We are looking for researchers with strong systems skills and passionate about driving innovations to improve the efficiency and effectiveness of deep learning systems. We value creativity, agility, accountability, and a desire to learn new technologies.

Responsibilities

• Drive and lead ground-breaking innovations to advance deep learning systems
• Drive cutting-edge research prototypes and assist in preparing for production deployments
• Discover/solve impactful technical problems, advance the state of the art, and turn ideas into production.
• Develop and maintain a cutting-edge open-source project to advance massive-scale deep learning
• Write concise, robust, and clean code
• Be passionate about making customers successful

Qualifications

Required Qualifications:

• Strong background and over 10 years of experience in designing and building high-performance computing systems (e.g., cache/memory optimization, high-performance GPU programming, compiler-based optimization, fine-grained parallel library and runtime), parallel/distributed systems (e.g., communication optimization, network architecture design, network programming) or machine learning systems.
• M.S or Ph.D. in Computer Science or related field, or equivalent, skills, and/or practical experience
• Passionate about delivering high-quality software
• Self-motivated and a great collaborator
• Ability to effectively communicate highly technical concepts and insights to a non-technical audience.
• Experience with distributed systems and at least one of the following C++, CUDA, Python

Preferred Qualifications:

• Strong track record of technology leadership in machine learning systems or large-scale distributed systems
• Experience with deep learning (DL) and familiarity with an existing DL framework (e.g., PyTorch, TF)
• Experience with performance analysis and optimization for CPUs and GPUs
• History of open source contributions and working with open source communities
• Ph.D. in Computer Science or related field is desirable

#DeepSpeed

#MachineLearning

#Cloud

#WebXTPlatform

Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form.

Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work.