Software Engineering
Tether
Tether is hiring an AI Research Engineer focused on kernel and inference optimization. The role advances model serving and inference architectures, optimizing model deployment and inference strategies to deliver responsive, efficient and scalable performance across real-world applications, from resource-constrained mobile devices to complex multi-modal systems that combine text, images and audio. The listing is titled 100% Remote Worldwide, and the posting lists work locations including Andorra, Argentina, Brazil, Spain, Italy, UAE, UK, Switzerland, Poland, Netherlands, Portugal, Ireland, Romania, India and Malaysia. Full-time permanent position. Salary is not disclosed in the listing.
4 more roles like this one.
Optimize model serving pipelines and inference frameworks for high-throughput, low-latency, low-memory-footprint AI performance. Establish performance metrics and identify production bottlenecks. Develop custom compute shaders and GPU kernels for smartphones. Build and deploy end-to-end inference pipelines on resource-constrained devices. Apply empirical research to overcome model serving challenges across distributed inference systems.
Computer Science degree or related background, ideally a PhD in NLP or Machine Learning with strong A-tier conference publications. Proficiency in Metal Shading Language with the ability to write custom compute shaders. Demonstrated low-level kernel optimization on mobile devices with measurable latency, throughput and memory gains. Deep knowledge of modern model serving architectures and inference optimization. Understanding of distributed inference using Tensor, Pipeline and Expert Parallelism. Mathematical understanding of Diffusion Models and Vision Transformers. Knowledge of pruning, quantization, flash attention, KV cache and speculative decoding.
CAD 164K - 197K/yr
See roles like this one
A free account opens every listing on EnRoute Jobs, saves the ones worth keeping, and scores each against your skills.
Create a free accountAlready have one? Log in
This job title typically pays $105,210 to $171,980 a year (median $135,980) for similar roles in the US.
Estimate from US Bureau of Labor Statistics data, not provided by the employer.