← Sottava, jobs the hour they open
Posted 10 mo agoFirst seen 14 d ago
Machine Learning Engineer — Inference Optimization
Posted by Featherless AI on 22 January 2026, 301 days ago. Still on their Ashby board when we checked 31 min ago.
What the posting is about
Optimize ML model inference for large-scale production. Collaborate with research to deploy new architectures. Improve system reliability and cost efficiency. Work in a fast-paced startup environment.
Your experience, ready for this role
Answer a few questions about your real work. Review the additions and download your CV.
Read out of the posting
LevelNot stated
Experience askedNot stated
EmploymentNot stated
LocationRemote (world)
Work arrangementRemote
Visa sponsorshipNot stated
SalaryNot extracted, check the posting
Posted2026-01-22
Found viaashby, direct from their system
We saw it 10 months after it went up.
The posting, as the company wrote it
ABOUT THE ROLE
We’re looking for a Machine Learning Engineer to own and push the limits of model inference performance at scale. You’ll work at the intersection of research and production—turning cutting-edge models into fast, reliable, and cost-efficient systems that serve real users.
This role is ideal for someone who enjoys deep technical work, profiling systems down to the kernel/GPU level, and translating research ideas into production-grade performance gains.
WHAT YOU’LL DO
- Optimize inference latency, throughput, and cost for large-scale ML models in production
- Profile and bottleneck GPU/CPU inference pipelines (memory, kernels, batching, IO)
- Implement and tune techniques such as:
- Quantization (fp16, bf16, int8, fp8)
- KV-cache optimization & reuse
- Speculative decoding, batching, and streaming
- Model pruning or architectural simplifications for inference
- Collaborate with research engineers to productionize new model architectures
- Build and maintain inference-serving systems (e.g. Triton, custom runtimes, or bespoke stacks)
- Benchmark performance across hardware (NVIDIA / AMD GPUs, CPUs) and cloud setups
- Improve system reliability, observability, and cost efficiency under real workloads
WHAT WE’RE LOOKING FOR
- Strong experience in ML inference optimization or high-performance ML systems
- Solid understanding of deep learning internals (attention, memory layout, compute graphs)
- Hands-on experience with PyTorch (or similar) and model deployment
- Familiarity with GPU performance tuning (CUDA, ROCm, Triton, or kernel-level optimizations)
- Experience scaling inference for real users (not just research benchmarks)
- Comfortable working in fast-moving startup environments with ownership and ambiguity
NICE TO HAVE
- Experience with LLM or long-context model inference
- Knowledge of inference frameworks (TensorRT, ONNX Runtime, vLLM, Triton)
- Experience optimizing across different hardware vendors
- Open-source contributions in ML systems or inference tooling
- Background in distributed systems or low-latency services
WHY JOIN US
- Real ownership over performance-critical systems
- Direct impact on product reliability and unit economics
- Close collaboration with research, infra, and product
- Competitive compensation + meaningful equity at Series A
- A team that cares about engineering quality, not hype
Copied from Featherless AI’s own board, not rewritten.
Also open at Featherless AI
Why this page exists
We read companies’ own hiring systems every hour, 2,106 of them, and show a job the hour it opens instead of when a job board gets around to indexing it. We saw it 10 months after it went up.
The feed is free. No card, no trial to expire.
A free account and your résumé first, no card