Not the right fit? Scroll more of our jobs below!
Location & Work Model
• Hybrid role based in the New York / New Jersey area
• Not a remote role, position will require on-site visits in Northern New Jersey and New York City.
Requires:
– All hands in office, once a week in the New York City office.
– On-site work during infrastructure buildouts
– On-site availability during incidents or critical operational events
– On-site time is driven by real infrastructure needs, not arbitrary policy
Overview
We are a small, highly technical firm seeking a Private Cloud Administrator to take primary ownership of our private cloud environment and infrastructure operations. This is a hands-on role for someone comfortable owning the full lifecycle of a private cloud platform, from virtualization and compute provisioning to automation, monitoring, and capacity planning, while partnering with a Managed Service Provider (MSP) for physical operations and after-hours coverage.
Our environment is predominantly on-prem, built on Linux and Proxmox VE, supporting custom-built applications. We are selectively extending into public cloud where it makes sense, with a particular focus on AI and specialized workloads.
This is a visible, high-trust role with real ownership, not a ticket-driven ops position.
About the Team
You will be the dedicated private cloud and infrastructure hire, working closely with a small engineering team that actively supports infrastructure efforts when needed. Day-to-day physical operations and after-hours coverage are handled by an MSP that you will manage and direct. You will interface with everyone at the firm, from end users to the engineering team to the Owner and C-Suite, so strong communication skills matter. This is a high-autonomy role where you set the direction for how our private cloud is architected, automated, and scaled.
What You’ll Do
• Own and administer the firm’s private cloud environment (Proxmox VE, Linux, containers)
• Lead automation and transition toward Infrastructure as Code (Terraform, Ansible, Pulumi, etc.)
• Design and manage all environments (production, test, development, corporate/end-user)
• Partner with and actively manage an MSP: you guide and manage, they execute
• Administer Linux production systems, virtualization clusters, and dev/test platforms
• Design CI/CD and deployment workflows in collaboration with developers
• Implement monitoring, backups, disaster recovery, access control, and security best practices
• Support vendor connectivity (cross-connects, tunnels, IP allowlisting)
• Help evaluate and design hybrid cloud infrastructure for AI workloads (e.g., GPU provisioning, model serving)
• Manage capacity planning, cost visibility, and resource optimization as systems scale
Tech Stack / Tools
• Linux: Ubuntu Server
• Virtualization: Proxmox VE
• CI/CD: GitLab CI
• Monitoring / Observability: MSP-managed for now; looking to bring in-house (e.g., Prometheus + Grafana, Zabbix, or similar)
• IaC / Configuration Management: To be introduced by this role: evaluate and adopt what fits (Terraform, Ansible, Pulumi, etc.)
• Containers / Orchestration: Docker today; Kubernetes adoption is a goal for this role
• Cloud: Primarily on-prem today; cloud strategy to be defined as needs arise (AI workloads, burst capacity)
• Networking: Palo Alto, FortiGate, Cisco, Netgear; FortiClient VPN, GlobalProtect VPN
What We’re Looking For
• Typically 4–8+ years of experience in private cloud administration, infrastructure engineering, or platform operations roles
• Strong hands-on experience administering Linux-based virtualization environments (KVM, Proxmox, or similar)
• Comfortable working across hardware, networking, OS, and automation
• Experience owning production systems and private cloud platforms end-to-end
• Proficient writing and maintaining scripts and tooling (Bash, Python, etc.)
• Experience with Infrastructure as Code tools (Terraform, Ansible, Pulumi, etc.)
• Experience guiding and holding MSPs accountable for execution
• Familiarity with endpoint management (Windows/macOS) via MDM or similar tooling
• Pragmatic mindset: documents clearly, builds cleanly, and improves continuously
• Takes ownership, calm under pressure, and always looking to improve
Nice to Have
• Exposure to AI/ML infrastructure (on-prem or cloud)
• Experience in regulated or latency-sensitive environments (e.g., financial services)
• Kubernetes or container orchestration experience
• Cloud certifications (AWS, GCP, Azure)
• Experience with Proxmox VE cluster administration, HA, and storage backends (Ceph, ZFS)
Compensation & Benefits
$150.000 -$180.000 plus discretionary bonus
Why This Role
• Real ownership, not ticket-driven operations
• Direct influence on infrastructure modernization and automation
• Close partnership with senior leadership
• Opportunity to architect and scale the firm’s private cloud for the next generation of platforms
