Software Engineer - Infrastructure (Mid - Senior) Job at Julius Ai, San Francisco, CA

  • Julius Ai
  • San Francisco, CA

Job Description

Compensation: Competitive base salary and meaningful equity

Benefits: Health & dental insurance, gym reimbursement, daily team meals, commuter benefits

We’re an applied AI lab building coding agents. Julius executes ~1M lines of code every 36 hours for 1M+ users and has generated 3M+ visualizations. All code runs in code sandboxes ( isolated remote containers ) that we manage. We’re revenue‑generating and backed by AI Grant, YCombinator, Bessemer Venture Partners and the founders from Vercel, Notion, Perplexity, Palantir, Replit, Zapier, Intercom, and Dropbox.

The Role

Build and scale the code‑execution sandboxes that power Julius across cloud environments (AWS and GCP). We orchestrate 500k+ containers/month and growing. You’ll own reliability, performance, and security for multi‑tenant compute.

What You’ll Do

  • Design and operate secure, multi‑tenant container infrastructure with fast startup and smart autoscaling.

  • Ship cloud deployments (Helm/Terraform) with SSO, network controls, and audit logging.

  • Drive observability (metrics, traces, logs) with clear SLOs; lead incident response.

  • Optimize images, scheduling, networking, and cost ; build fair‑use and rate‑limiting controls.

What You Bring

  • Production Kubernetes and container internals (Docker/containerd); strong networking fundamentals.

  • Cloud (AWS/GCP/Azure) and IaC (Terraform/Helm).

  • Monitoring/Logging (Prometheus, Grafana, OpenTelemetry, ELK/Vector).

  • Security best practices for containerized, multi‑tenant systems.

Nice to Have

  • gVisor/Kata/Firecracker; Cilium/eBPF; GPU scheduling; serverless autoscaling (KEDA/Knative/Karpenter).

  • You’ve built an AI side project and enjoy tinkering with LLMs.

Why Julius

Small, senior team; massive impact surface; hard infra problems at meaningful scale.

Job Tags

Full time, Remote work

Similar Jobs

Maria Fareri Children's Hospital, a member of the WMCHealth ...

Social Worker Job at Maria Fareri Children's Hospital, a member of the WMCHealth ...

 ...Social Worker The Social Worker performs advanced clinical evaluations and treatment of persons in need of medical or mental health...  ...class, however leadership and training of recent graduates, entry level social workers, and social work students is a feature of this... 

A Hiring Company

On-Site Property Manager Job at A Hiring Company

 ...bath unit with utilities paid), plus sick leave, vacation, and holiday payWe are seeking a reliable, On-Site Apartment Manager to oversee daily operations and property upkeep at a 73-unit apartment complex in Clute, Texas. This position requires living on-site and being... 

Sutherland

Customer Service Representative - Temporary Job at Sutherland

 ...solutions? Do you have an enthusiastic personality and a strong attention to detail? Join Us. Job Description Temporary position- 6 month contract In this work from home role, you will have the opportunity to work with, and directly assist, both families and... 

State of Iowa

Correctional Officer Job at State of Iowa

 ...Correctional OfficerJoin us at Clarinda Correctional Facility as a Correctional Officer. At the full performance level, maintains security and manages offenders consistent with their programming and behavioral objectives in an adult correctional institution; performs related... 

Next Level Exchange

Executive Recruiter Job at Next Level Exchange

 ...Job description Executive Recruiter Nurse Management & Hospital Leadership Build Meaningful Relationships. Lead Executive Searches...  ...through hands-on mentorship, coaching, and formal training resources. Supportive Culture: Join a team that values collaboration...