Research Engineer at Meta in Pittsburgh, Pennsylvania

Job Description:

The Codec Avatars Lab brings together a world-class and cross-discipline R&D team with the shared goal of developing the next generation of AR and VR experiences. In our Lab, we are revolutionizing the way we interact with each other in the era of the metaverse - in the form of a pioneering technology called codec avatars. These avatars achieve unprecedented realism, yet integrating these avatars into sensing systems that allow live-drivability and controllability remains challenging.A talented Research Engineer is now sought after to own the algorithmic exploration and integration of live-drivable avatars, connecting them to state-of-the-art foundational AI models. This work involves handling of various techniques in generative modeling, understanding and improving complexity and efficiency limitations, and full-stack latency reduction for live systems. An ideal candidate should be passionate in these areas, while contributing to other research engineering topics around codec avatars; strong scientific coding, documentation, and interpersonal communication skills are essential.Join us on the adventure of a lifetime as we make science fiction real and change the world!

Research Engineer Responsibilities:

• Design, implement and analyze complex live systems that combine various machine learning techniques and connect state of the art generative models with neural renderers


• Collaborate with fellow staff members to develop research ideas, experiments, sensor prototypes, and processing pipelines to advance the SOTA in realistic telepresence


• Deliver readable, maintainable and scalable code in support of these activities


• Analyze and improve latency of large-scale machine learning models such as diffusion models or LLMs

Minimum Qualifications:

• Currently has, or is in the process of obtaining a Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience. Degree must be completed prior to joining Meta.


• Experience with languages and frameworks such as Python, C++, and PyTorch.

Preferred Qualifications:

• Familiarity with select topics related to realistic representations of human


• Understanding of the full machine vision pipeline from hardware to algorithms


• Demonstrated track record of publication in top conferences such as CVPR, ECCV, ICLR, NeurIPS, and SIGGRAPH


• Experience developing an end-to-end ML pipeline that includes data preprocessing, model development, deployment, and optimization


• Experience with generative models such as Large Language Models and Diffusion Models

About Meta:

Meta builds technologies that help people connect, find communities, and grow businesses. When Facebook launched in 2004, it changed the way people connect. Apps like Messenger, Instagram and WhatsApp further empowered billions around the world. Now, Meta is moving beyond 2D screens toward immersive experiences like augmented and virtual reality to help build the next evolution in social technology. People who choose to build their careers by building with us at Meta help shape a future that will take us beyond what digital connection makes possible today-beyond the constraints of screens, the limits of distance, and even the rules of physics.



Meta is proud to be an Equal Employment Opportunity and Affirmative Action employer. We do not discriminate based upon race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender, gender identity, gender expression, transgender status, sexual stereotypes, age, status as a protected veteran, status as an individual with a disability, or other applicable legally protected characteristics. We also consider qualified applicants with criminal histories, consistent with applicable federal, state and local law. Meta participates in the E-Verify program in certain locations, as required by law. Please note that Meta may leverage artificial intelligence and machine learning technologies in connection with applications for employment.

Meta is committed to providing reasonable accommodations for candidates with disabilities in our recruiting process. If you need any assistance or accommodations due to a disability, please let us know at accommodations-ext@fb.com.


$56.25/hour to $137,000/year + bonus + equity + benefits


Individual compensation is determined by skills, qualifications, experience, and location. Compensation details listed in this posting reflect the base hourly rate, monthly rate, or annual salary only, and do not include bonus, equity or sales incentives, if applicable. In addition to base compensation, Meta offers benefits. Learn more about benefits at Meta. Apply Now