Cerebras Systems
About Cerebras Systems
Cerebras Systems has pioneered a groundbreaking chip and system that revolutionizes deep learning applications. Our system empowers ML researchers to achieve unprecedented speeds in training and inference workloads, propelling AI innovation to new horizons.
The Condor Galaxy 1 (CG-1), unveiled in a recent announcement, stands as a testament to Cerebras’ commitment to pushing the boundaries of AI computing. With a staggering 4 ExaFLOP processing power, 54 million cores, and 64-node architecture, the CG-1 is the first of nine powerful supercomputers to be built and operated through an exclusive partnership between Cerebras and G42. This strategic collaboration aims to redefine the possibilities of AI by creating a network of interconnected supercomputers that will collectively deliver a mind-boggling 36 ExaFLOPS of AI compute power upon completion in 2024.
Cerebras is building a team of exceptional people to work together on big problems. Join us! https://www.cerebras.net/
About the Role
As an applied machine learning engineering assistant, you will take today’s state-of-the-art solutions in various verticals and adapt them to run on the new Cerebras system architecture. You will get to see how deep learning is being applied to some of the world’s most difficult problems today and help ML researchers in these fields to innovate more rapidly and in ways that are not currently possible on other hardware systems.
Responsibilities
- Familiar with state-of-the-art transformer architectures for language and vision model.
- Bring up new state-of-the art model on Cerebras System and function validation.
- Train a model to convergence, and hyper-parameter tuning.
- Optimize model code to run efficiently on Cerebras System.
- Explore new model architecture that take advantage of Cerebras unique capabilities.
- Develop new approaches for solving real world AI problems on various domains.
Requirements
- Enrolled in the University of Toronto’s PEY program with a degree in Computer Science, Computer Engineering, or other related disciplines
- Familiarity with JAX/TensorFlow/PyTorch
- Good understanding of how to define custom layers and back-propagate through them.
- Experience with transformer deep learning models
- Experience in vertical such as computer vision or language modeling
- Experience with Large Language Models such as GPT family, Llama, BLooM
Cerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.
This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice.
Apply now
To help us track our recruitment effort, please indicate in your cover/motivation letter where (jobsinengineering.ca) you saw this job posting.