Principal Site Reliability Engineer-FedRAMP (REMOTE USA) @ Splunk - Los Angeles, CA

Job Overview

a month ago

Principal Site Reliability Engineer-FedRAMP (REMOTE USA)

Splunk - Los Angeles, CA

Join us as we pursue our disruptive vision to make machine data accessible, usable and valuable to everyone. We are a company filled with people who are passionate about our product and seek to deliver the best experience for our customers. At Splunk, we’re committed to our work, customers, having fun and most significantly to each other’s success. Learn more about Splunk careers and how you can become a part of our journey!


Splunk's Cloud Services group is looking for a Principal Site Reliability Engineer to help lead, design and build the next generation of our large scale cloud offering. You will be working on core services and applications that form the primitives for our current and future cloud service offerings. Principal Site Reliability Engineers in this role will be engaging with multiple service owners across the platform to teach and implement modern interpretations of SRE, observability, Chaos Engineering and DevOps. This role is highly visible and impactful to the organization and will help shape Splunk's Engineering culture for years to come. Your job, in a nutshell, is to make every team around you better... including your own!

This is a remote role available in all US states except AK, ND, and WY. You also have the option of an office desk in some locations if that's convenient and desirable for you!

You will:

  • OwnSplunk Cloud in FedRAMP environments.
  • Work across the organization to deliver quality products that delight Splunk's passionate users.
  • Lead teams of tight-knit engineers who are building a state-of-the-art, cloud-based environment for massive-scale data processing.
  • Mentor and help new engineers to achieve more than they thought possible. You enjoy making other teams successful and are fulfilled through the success of others.


  • You have experience or an interest in working with regulated computing environments such as FISMA and/or FedRAMP and are enthusiastic about doing it better.
  • This is a fully remote, US-based/work-from-home position. You must be a US Citizen working on US soil to be considered.
  • You have owned and operated Kubernetes clusters and the associated ecosystems. Kubernetes certifications or an interest in obtaining these certifications are a plus, such as those from the Cloud Native Computing Foundation; Certified Kubernetes Administrator (CKA), Certified Kubernetes Application Developer (CKAD), or Certified Kubernetes Security Specialist (CKS).
  • You enjoy building and running distributed systems at scale in production. You understand the challenges and trade-offs to be made when building and deploying systems to production.
  • Deep understanding of linux systems (network stack, file system, OS services) and networking (L2 vs. L3, network architecture, VLANs, etc)
  • Experience with at least one programming language, preferably Golang (go) or python. Knowledge of working with and automating linux systems tasks using this language is required, including working with configuration files and system services. Knowledge of common data structures and algorithms, as well as their performance characteristics is required.
  • Knowledge of standard methodologies related to security, performance, and disaster recovery.
  • Highly skilled in identifying performance bottlenecks, identifying anomalous system behavior, and resolving root cause of service issues.
  • You have assembledOpen Source components into cohesive services.
  • You've demonstrated the skills to effectively work across teams and functions to influence design, operations and deployment of highly available software.
  • You are interested in working hard to make the users of Splunk's products happier every day.

Preferred skills:

  • Experience monitoring cloud environments with Splunk.
  • Experience with development and deployment in a hosted cloud environment, preferablyAWS& GCP. Cloud certifications are a plus or an interest in obtaining these certifications, such as AWS Certified Solutions Architect, AWS Certified DevOps Engineer, or Google Associate Cloud Engineer (ACE).
  • Experience with large scale distributed cloud service development, infrastructure, traffic management and architecture.
  • Experience with distributed architectures/systems with optimized and scalable software that operates on a large number of nodes.

We value diversity, equity, and inclusion at Splunk and are an equal employment opportunity employer. Qualified applicants receive consideration for employment without regard to race, religion, color, national origin, ancestry, sex, gender, gender identity, gender expression, sexual orientation, marital status, age, physical or mental disability or medical condition, genetic information, veteran status, or any other consideration made unlawful by federal, state, or local laws. We consider qualified applicants with criminal histories, consistent with legal requirements.

Note: Splunk provides flexibility and choice in the working arrangement for most roles, including remote and/or in-office roles. We have a market-based pay structure which varies by location. Please note that the base pay range is a guideline and for candidates who receive an offer, the base pay will vary based on factors such as work location as set out below, as well as the knowledge, skills and experience of the candidate. In addition to base pay, this role is eligible for incentive compensation and benefits, and may be eligible for equity.

Benefits are an important part of Splunk's Total Rewards package. This role is eligible for a competitive benefits package which includes medical, dental, vision, a 401(k) plan and match, paid time off, an ESPP and much more! Learn more about our comprehensive benefits and wellbeing offering here.

Base Pay Range

SF Bay Area, Seattle Metro, and New York City Metro Area

Base Pay Range: $180,800 - 248,600 per year

California (excludes SF Bay Area), Washington (excludes Seattle Metro), Washington DC Metro, and Massachusetts

Base Pay Range: $171,200 - 235,400 per year

All other cities and states excluding California, Washington, Massachusetts, New York City Metro Area and Washington DC Metro Area.

Base Pay Range: $153,600 - 211,200 per year

Similar Jobs


Director, Scholar Services

Alliance College-Ready Public Schools (Home Office)

Los Angeles, CA

Curate guidance, resources, and support for Homeless and Foster Youth Liaisons at each school site. This position will work from a home office in the greater…

Los Angeles, CA

Prior experiences in in vitro and in vivo experiments at an investigator site or academic medical center is highly preferred, but not required.

Rancho Cucamonga, CA

Coordinate and complete pre-job site surveys. Adhere to Linde safety principals, policies and guidelines. Complete required job reports including: job site logs…

Los Angeles, CA

Conduct and document on-site observations; process submittals, RFI’s substitution requests and shop drawings during construction.

Bakersfield, CA

Consult with customer regarding all repair and safety related issues and discuss recommendations to assist the customer with improving their material handling…


San Diego, CA

Under the direction of an Assistant Principal, patrol and supervise campus activities to assure the well-being and safety of students, staff and visitors in…


Site Coordinator

Action Youth America

East San Gabriel, CA

’ Develops, implements, and evaluates enrichment activities at school site. Arranges site visitations for school district visitors, makes constructive contact…


After School Site Coordinator

Action Youth America

Temple City, CA

’ Develops, implements, and evaluates enrichment activities at school site. Arranges site visitations for school district visitors, makes constructive contact…


Irvine, CA

Provide direct principal HR consulting to key clients. Remote work with some travel to client sites required. Assist the CEO with marketing ideas, materials and…


REPOSTED * Custodian Lead - Warm Springs Middle School

Murrieta Valley Unified School District

Murrieta, CA

Communicates daily with site administrator. Assists in routine safety and site inspections. Assists the assigned administrator in establishing and coordinating…


School Social Worker

Grimmway Schools

Arvin, CA

The School Social Worker will serve as liaison between the home office and school sites to ensure site case managers are equipped with the knowledge and tools…

Santa Barbara, CA

Reporting*: Reports to a school site principal or other certificated administrator. La Cumbre Special Education Paraeduator I positions are 6 hours of work a…

Hemet, CA

Maintenance and articulation of permanent student records; assists in interpreting district and school programs to parents new to the district and to interested…


Hemet, CA

Maintenance and articulation of permanent student records; assists in interpreting district and school programs to parents new to the district and to interested…

Anaheim, CA

Customer site vaccination requirements must be followed when work is performed at a customer site. May occasionally require on-site work at a data center during…

Long Beach, CA

Ability to transport sports equipment to program site(s). Develop relationships with school principals, office staff, teachers and rec aids.

Calabasas, CA

Safeguarding and maintaining highly sensitive and confidential information of LSI, the client and/or principal. CPR/AED certification is desired.


Armed Security Guard

Strategic Security Corp

Los Angeles, CA

In addition to providing physical security, this role will participate in SSC's G.E.T. principals. Ensure job site area with your area of control is clean and…

Los Angeles, CA

St. Joseph Center’s integrated programs provide clients with concentrated and coordinated access to services according to the nature of their needs.

Redondo Beach, CA

Specific tasks performed in this role may include: integrated systems evaluation, assisting with or leading F-35 flight-test data analysis/troubleshooting and…

Palmdale, CA

Ability to work on-site daily in Palmdale, CA or San Diego, CA. Shift: 1st Shift (United States of America). Travel Required: Yes, 10% of the Time.

Woodland Hills, CA

Shift: 1st Shift (United States of America). Travel Required: Yes, 10% of the Time. Relocation Assistance: Relocation assistance may be available.

Orange, CA

And coordinate with a broad range of other disciplines within AECOM. It is also expected to identify and pursue new clients/projects with business development…

Orange, CA

Some local site travel required. The candidate will have the opportunity to direct projects for a variety of facilities including dams, pipelines, tunnels,…