[Hiring] Senior Hadoop Administrator @DMS Vision

Role Description

Sr. Hadoop Administrator (Remote)

Location: 3 Edison Drive, Alpharetta, GA, 30022 (Remote Role)

Duration: 6 months

Note: Preference to have candidate local to Alpharetta, Chicago, New York, New Jersey, or California.

Job Description:

• Expert in setting up Hadoop cluster from scratch and server maintenance.
• Commissioning and decommissioning of the nodes to/from Hadoop cluster.
• Implementing, managing, and administering the overall Hadoop infrastructure.
• Capacity planning and estimating the requirements for lowering or increasing the capacity of the Hadoop cluster.
• Monitoring the Hadoop cluster connectivity and performance of the cluster for application teams.
• Replicating huge amount data from one Hadoop cluster to another.
• Applying encryption to secure the data in the Hadoop cluster.
• Applying the configuration changes and testing the cluster in collaboration with the application teams and business users.
• Sound knowledge of Hadoop services - HDFS, Hive, HBase, Impala, Hue, Ranger etc.
• Experience with Cloudera CDP Hadoop upgrade.
• Experience with access management and setting up user roles in Hadoop.
• Able to create and debug complex Unix shell scripts.

Nice to have:

• Analyzing and troubleshooting the issues with the clusters.
• Set up and maintain appropriate infrastructure to maintain performance and data integrity.
• Experience with ELK Stack: Elasticsearch, Logstash, Kibana, Apache Hadoop.
• Ensuring appropriate monitoring & alerting of Elasticsearch cluster.
• Expert in networking and security settings to support network related pipelines.
• Good to have Ruby and/or Python, Unix and GIT Knowledge.

Soft Skills:

• Good verbal and written communication skills.
• Good analytical and problem-solving skills.
• Good team player.

Company Description