Site Reliability Engineer Job at Berkley Hunt, San Jose, CA

clc1SDhzcE9NWHZvdzJlQ0pDZFJRVFlTY0E9PQ==
  • Berkley Hunt
  • San Jose, CA

Job Description

Senior Site Reliability Engineer (GPU Compute) | Hybrid – Bay Area, CA

Berkley Hunt is supporting a fast-growing AI startup building a high-performance, cloud-native platform to power cutting-edge machine learning workloads. As they scale, they’re hiring a Senior/Staff Infrastructure Engineer to lead the development of a scalable GPU compute environment from the ground up.

About the Role:

This is a high-impact role for an experienced infrastructure engineer who thrives in fast-paced environments and wants to shape the future of AI infrastructure. You’ll design, build, and operate the systems that enable high-throughput GPU workloads at scale—collaborating closely with the core engineering team to optimize performance, efficiency, and reliability.

If you're excited about solving deep technical challenges in distributed compute and cloud automation, this could be a standout opportunity.

Responsibilities:

  • Build and maintain a large-scale, distributed GPU compute platform powering AI workloads.
  • Develop backend systems in Python to orchestrate GPU jobs, manage routing, observability, and capacity.
  • Design and implement infrastructure with tools like Terraform, Ansible, and Kubernetes across cloud and bare metal environments.
  • Own the reliability, scalability, and performance of the platform, from provisioning to deployment and monitoring.
  • Collaborate with the engineering team to shape infrastructure vision and technical strategy over the next 1–5 years.
  • Drive automation and improvements to minimize operational overhead and scale efficiently.

Requirements:

  • 6+ years of experience in cloud infrastructure or backend engineering roles.
  • Deep knowledge of distributed compute systems, especially involving GPU orchestration.
  • Proficiency with Python and infrastructure-as-code tools (e.g., Terraform, Ansible).
  • Solid experience with Kubernetes and CI/CD pipelines.
  • Strong understanding of cloud platforms (AWS, GCP, or Azure); bare metal experience is a plus.
  • Excellent problem-solving skills and a proactive, ownership-driven mindset.

Nice to Have:

  • Experience at a high-growth startup or in scaling large infrastructure systems.
  • Familiarity with GPU resource scheduling and performance optimization.
  • Hands-on experience with observability stacks (Prometheus, Grafana, Loki, Thanos).
  • A passion for automation, infrastructure design, and moving fast without breaking things.

Job Tags

Similar Jobs

LanceSoft

Travel Sterile Processing Technician Job at LanceSoft

 ...Job Description LanceSoft is seeking a travel Sterile Processing Technician for a travel job in Cedar Rapids, Iowa. Job Description & Requirements ~ Specialty: Sterile Processing Technician ~ Discipline: Allied Health Professional ~ Start Date: 02/02/2026... 

Mission Driven Distributors

Warehouse Operator Job at Mission Driven Distributors

 ...Description Job Description Mission Driven Distributors (MDD) is looking for a safe, dedicated, and detail-focused Warehouse Operator to join our distribution center team in Aurora! We are not just moving boxes, we are building connections and a brand of performance... 

Banner University Med Ctr Phoenix - Envision Physician Servi...

Anesthesiology - Physician Job at Banner University Med Ctr Phoenix - Envision Physician Servi...

 ...anesthesiology, emergency medicine, hospital medicine and other health services in partnership with clinical departments in diverse facilities...  ...are proud to be an EOE/AA employer. Facility Information: Banner University Medical Center Phoenix, formerly Banner Good... 

SAGINAW COUNTY COMMUNITY MENTAL HEALTH AUTHORITY

Mental Health Activity Aide - Full Time / CTS Job at SAGINAW COUNTY COMMUNITY MENTAL HEALTH AUTHORITY

SCCMHA JOB VACANCY ANNOUNCEMENT Mental Health Activity Aide - Full Time Pay range: $22.15 - $24.58 hourly *** ***Pay Range includes a $5.40 Direct Care Wage Stipend from the Michigan Department of Health and Human Services (MDHHS) for direct hands on care hours...

Nightingale Nurses

Travel CVOR Operating Room Registered Nurse (Endovascular) Job at Nightingale Nurses

 ...Job Description Nightingale Nurses is seeking a travel nurse RN CVOR for a travel nursing job in Camden, New Jersey. Job Description...  ...travel nursing assignments all over the US, as well as the highest pay rates and most extensive benefits in the industry. \n...