anyone-ai logo

AWS Trainium / NKI Kernel Expert

anyone-ai
Remote
Remote$135k–$135k· about 22 hours ago

Straight from anyone-ai’s careers page. Apply on the company site — no recruiter, no middleman.

AWS Trainium / NKI Kernel Expert

Department: Software Engineering

Location: Argentina - Fully Remote, Uruguay, Chile, Ecuador - Fully Remote, Portugal, Mexico - Fully Remote, Colombia - Fully Remote, Spain, Brazil

Compensation: $65 per hour

Employment Type: Contract

Anyone AI is recruiting experienced AWS Trainium / Neuron Kernel Interface (NKI) engineers for a specialized project focused on evaluating and improving kernel development tasks for AI workloads.

We’re looking for engineers with hands-on experience building or optimizing NKI kernels on AWS Trainium or Inferentia2 hardware who understand how Trainium’s architecture differs from traditional GPU programming.

What You’ll Work On

You’ll review and evaluate technical tasks involving:

  • NKI kernel correctness and Trainium-specific development patterns

  • CUDA → NKI kernel migrations

  • Trainium performance optimization and benchmarking

  • Memory management across SBUF, PSUM, and HBM

  • Tile-based computation and DMA scheduling

  • Cross-platform numerical correctness between CUDA/Triton and NKI

  • Trainium-specific performance bottlenecks and optimization opportunities

  • Technical feedback and quality assessment of kernel implementations

The work involves determining whether implementations are not only technically correct, but also idiomatic and optimized for Trainium hardware rather than simply translated from GPU-based approaches.

What We’re Looking For

  • 2+ years of hands-on experience developing or optimizing kernels with the Neuron Kernel Interface (NKI)

  • Experience working with AWS Trainium and/or Inferentia2

  • Strong understanding of:

    • Tile-based computation

    • SBUF / PSUM / HBM memory hierarchy

    • Partition dimension constraints

    • DMA orchestration

    • Trainium-specific optimization techniques

  • Ability to evaluate CUDA → NKI migrations

  • Experience profiling and optimizing workloads on Trainium

  • Understanding of numerical differences across GPU and Trainium backends

  • Strong ability to analyze complex technical implementations and provide clear written feedback

Nice to Have

  • Experience with the AWS Neuron SDK or Neuron Compiler

  • CUDA or Triton kernel development experience

  • Knowledge of NeuronCore-v2 architecture

  • Experience with FP32, BF16, FP8, and INT8 workloads

  • Experience benchmarking workloads on Trn1 or Trn2 instances

  • Familiarity with nki.language, @nki.jit, or XLA custom calls

  • Experience with technical evaluation, AI/ML data projects, RLHF, or rubric-based assessment

Engagement

Work Type: Remote
Engagement: Part-time, project-based consulting
Focus: AWS Trainium / NKI kernel engineering and technical evaluation

This is a strong fit for engineers who have worked deeply with AWS Trainium infrastructure and low-level ML kernel optimization and are interested in applying that expertise to technically challenging AI projects.

Similar remote jobs

More like this →
Synthio Labs logo

Synthio Labs

Platform Engineer

Remote
✓ From careers page· 25 minutes ago
Synthio Labs logo

Synthio Labs

AI Engineer

Remote
✓ From careers page· 25 minutes ago
Abnormal AI logo

Abnormal AI

Software Engineer, Behavioral Security Products

Remote
✓ From careers page· 25 minutes ago
Abnormal AI logo

Abnormal AI

Senior Software Engineer - Model Platform (Remote)

Remote
$180k–$259k
✓ From careers page· 25 minutes ago

Discover More than 100,000 Hidden Remote Jobs Before Everyone Else

Unlock All Remote Jobs Today

Simple pricing. Big savings on Quarterly and Yearly.

Monthly Access

$19/month
  • Instant access to fresh remote jobs from 500+ companies
  • New opportunities added hourly, often 3-7 days before anywhere else
  • Advanced filtering by role type, stack, pay, and location
  • Priority customer support
Start 7-day trial — $2.95
Most Popular

Yearly Access

$59/year
  • Everything in Monthly
  • Save $169 (~74%) vs paying monthly
  • Average job search takes ~6 months - get covered for the whole journey
  • Less than the cost of one lunch per month for competitive advantage
  • Equivalent to just ~$4.92/month
Start 7-day trial — $2.95