, Inc Lead Systems / Hadoop Engineer in San Francisco, California

Job CategoryProducts and Technology

Job Details

Role Description:As a Systems and Hadoop Engineer for the TechOps team, you will deliver and support technology infrastructure to meet the substantial growth needs of the business. This role will be part of a strategic team responsible for keeping production services operational, as well as supporting the various test infrastructure in place to support engineering needs.

Successful candidates will be recognized as technical experts in the Systems Engineering discipline, with an emphasis of Hadoop support. Candidate will have the ability to articulate and demonstrate both deep and broad knowledge across multiple areas of information technology in support of a SaaS/PaaS infrastructure. We are looking for innovative and enthusiastic technologists who thrive on efficiency by contributing to the development of standards, processes, and automation requirements that lead to operational excellence.

Team Description:

High-quality data lets customers understand, adapt, focus, and execute with surgical precision. at Salesforce offers a suite of products to give business the high-quality data it needs when it needs it. Technical Operations team, provides infrastructure to search, match and enhance customer data. This team supports and manages 3rd party vendor data to empower customers with data when they need it. Engineering technology stack is Java, Hadoop, HBase, Solr, Membase, Elastic Search & MySQL. Majority of the components are dockerized and zero downtime deployments are powered through RunDeck scripts. The team also supports CI environments with Mac & Linux hardware for growing Mobile development teams at Salesforce.

Your Impact:

  • Use existing tools to build infrastructure and deploy code to production instances.

  • Keen troubleshooting capabilities to help ensure that uptime is maintained around a multi-tiered service stack

  • Responsible for design, implementation and ongoing administration of Hadoop infrastructure

  • Working with Dev team to set up Kerberos principals and testing HDFS and MapReduce access

  • Build solutions around automation, tooling, monitoring, management to improve the availability, throughput and customer reach, adoption and Self-Serve capabilities.

  • Support cutting edge technologies including Docker and distributed storage.

  • Establish and recommend policies on service maintenance, use, performance and roles.

  • Work directly with and within the team in building and deploying highly available, robust, resilient, secure and supportable solutions

  • HDFS/HBase support and maintenance

  • Performance tuning of Hadoop Cluster, Hbase, MR/Yarn and Spark Jobs

  • Provide metrics associated with source system specific use cases in the Hadoop cluster

  • Execute production Change Management, Problem Management and Incident Response procedures

  • Process automation as it applies to the provisioning of resources within their Information Technology discipline. Examples of tools in this category include CFEngine, RunDeck, Puppet.

  • Collaborating with application teams on new services/features and capacity planning as per business needs

  • Backup and restore management: use backup and recovery best practices to ensure systems are protected from data loss in compliance with established business continuity and DR practices.

  • MySQL DBA support and maintenance

Basic Requirements:

  • Must have experience managing Hadoop Clusters, including providing monitoring and administration support

  • 5+ years of experience in Linux or Solaris-based Systems Engineering for high-volume high-availability transactional environments with 24x7x365 uptime requirements

  • Proven ability to conduct detailed performance analysis tasks in Linux/UNIX

  • Experience with deploying and troubleshooting code to production environments

  • Strong scripting skills in any UNIX shell, Perl, Python, and/or Ruby with the ability to provide requirements for task automation, resource monitoring and performance monitoring

  • Is familiar with set-up and configuration of log aggregation utilities, such as syslog-ng

  • Understands fundamentals of networking, including the OSI model, network segmentation best practices, routing, and common protocols and concepts

  • Working knowledge of most of the following protocols is expected: IPv4, IPv6, TCP, UDP, HTTP, SSL/TLS, RTP, DNS, NFS, NIS/NIS+, and SMTP

  • Extensive troubleshooting and performance monitoring skills

  • Hands-on experience with production hardware life-cycle management

  • Prior experience working within a regulatory compliance framework

  • Working knowledge of system hardening best practices and methods and access control methodologies

Preferred Requirements:

  • Strong programming skills in Python

  • Experience with AWS, OpenStack or Azure for scaling web and mobile application backend infrastructure

  • Experience with building and managing Continuous Integration (CI) environment and servers

  • Experience in setting up Linux users, setting up Kerberos principals and testing HDFS, and MapReduce access for the new users

  • Expertise in Cluster maintenance as well as creation and removal of nodes using tools like Ganglia, Nagios and Cloudera Manager Enterprise

  • Hadoop ecosystem programming experience highly desirable, especially Apache Spark, Apache HBase

  • Experience with enterprise monitoring systems (e.g. Nagios)

Salesforce, the Customer Success Platform and world's #1 CRM, empowers companies to connect with their customers in a whole new way. The company was founded on three disruptive ideas: a new technology model in cloud computing, a pay-as-you-go business model, and a new integrated corporate philanthropy model. These founding principles have taken our company to great heights, including being named one of Forbes’s “World’s Most Innovative Company” six years in a row and one of Fortune’s “100 Best Companies to Work For” nine years in a row. We are the fastest growing of the top 10 enterprise software companies, and this level of growth equals incredible opportunities to grow a career at Salesforce. Together, with our whole Ohana (Hawaiian for "family") made up of our employees, customers, partners and communities, we are working to improve the state of the world.*LI-Y

Posting Statement and are Equal Employment Opportunity and Affirmative Action Employers. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender perception or identity, national origin, age, marital status, protected veteran status, or disability status. Headhunters and recruitment agencies may not submit resumes/CVs through this Web site or directly to managers. and do not accept unsolicited headhunter and agency resumes. and will not pay fees to any third-party agency or company that does not have a signed agreement with or

Pursuant to the San Francisco Fair Chance Ordinance and the Los Angeles Fair Chance Initiative for Hiring, Salesforce will consider for employment qualified applicants with arrest and conviction records.

Salesforce, the Customer Success Platform and world's #1 CRM, empowers companies to connect with their customers in a whole new way. We are the fastest growing of the top 10 enterprise software companies, the World's Most Innovative Company according to Forbes, and one of Fortune's 100 Best Companies to Work For six years running. The growth, innovation, and Aloha spirit of Salesforce are driven by our incredible employees who thrive on delivering success for our customers while also finding time to give back through our 1/1/1 model, which leverages 1% of our time, equity, and product to improve communities around the world. Salesforce is a team sport, and we play to win. Join us!