Principal Engineering Manager

Large language models (LLM) such as Open AI ChatGPT, GPT-4, power the Gen-AI revolution that is creating a renaissance across Microsoft as well as Azure customers.
As the number of scenarios and customer usage of Copilot(s) increases, an efficient fabric optimizing availability and utilization of inference capacity is the key to fulfilling the fast-pace demand growth.
As a Principal Engineering Manager, you will be responsible for leading a team developing the Inference fabric that powers the most advanced large language models (LLM).
Work at the cutting-edge of Gen-AI technology.
Responsibilities Build, deliver, and support high-quality distributed services to power the ML experience.
Drive product execution with clarity, including translating abstract problem statement into a high-quality product strategy and design.
Create an inclusive environment to attract, retain and grow strong and diverse talent.
Provide technical leadership, vision, and manage relationships and requirements with downstream platform teams.
Qualifications Required/Minimum Qualifications: Bachelor's Degree in Computer Science, or related technical discipline AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
5+ years of experience in highly reliable distributed systems.
3+ years of leadership experience, with demonstrated ability to lead, motivate, and build results-oriented development teams.
Other Requirements: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter.
Additional or Preferred Qualifications: Bachelor's Degree in Computer Science or related technical field AND 10+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
10+ years of hands-on engineering experience (both as engineer and manager) working through the full product cycle from initial architecture design to final product delivery and support.
4+ years people management experience.
Experience building new micro-services.
Experience with AI platforms is preferred but not required.
Familiarity with Azure.
Software Engineering M5 - The typical base pay range for this role across the U.
S.
is USD $133,600 - $256,800 per year.
There is a different range applicable to specific work locations, within the San Francisco Bay area and New York City metropolitan area, and the base pay range for this role in those locations is USD $173,200 - $282,200 per year.
Certain roles may be eligible for benefits and other compensation.
Find additional benefits and pay information here: https://careers.
microsoft.
com/us/en/us-corporate-pay Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.
#AIPLATFORM# Microsoft is an equal opportunity employer.
Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances.
If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations.