5-plus years of DevOps experience managing the Big Data application stack including HDFS, YARN, Spark, Hive and Hbase
Deeper understanding of all the configurations required for installing and maintaining the infrastructure in the long run
Experience setting up high availability, configuring resource allocation, setting up capacity schedulers, handling data recovery tasks • Experience with middle-layer technologies including web servers (httpd, ningx), application servers (Jboss, Tomcat) and database systems (postgres, mysql)
Experience setting up enterprise security solutions including setting up active directories, firewalls, SSL certificates, Kerberos KDC servers, etc.
Experience maintaining and hardening the infrastructure by regularly applying required security packages and patches
Experience supporting on-premise solutions as well as on AWS cloud
Experience working with and supporting Spark-based applications on YARN Experience with one or more automation tools such as Ansible, Teraform, etc
Experience working with CI/CD tools like Jenkins and various test report and coverage Plugins
Experience defining and automating the build, versioning and release processes for complex enterprise products • Experience supporting clients remotely and on-site • Experience working with and supporting Java- and Python-based tech stacks would be a plus.
Desired Non-technical Requirements
• Very strong communication skills both written and verbal
• Strong desire to work with start-ups
• Must be a team player.