Hadoop Admin

Hadoop AdminLocation: Austin, TX (Onsite) FTE ONLYMust Have Technical/Functional Skills • Performance tuning of Hadoop clusters and Hadoop workloads. • Screen Hadoop cluster job performances and capacity planning at application/queue level • Monitor Hadoop cluster connectivity and security • Manage and review Hadoop log files. • File system management and monitoring. • Implementation and ongoing administration of Hadoop infrastructureRoles & Responsibilities • Responsible for implementation and ongoing administration of Hadoop infrastructure. • Aligning with the systems engineering team to propose and deploy new hardware and software environments required for Hadoop and to expand existing environments. • Working with data delivery teams to setup new Hadoop users/applications. This job includes onboarding activities like setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Pig, Spark and MapReduce access for the new users/applications. • Cluster maintenance as well as creation and removal of nodes using tools like Ambari and other home-grown tools. • Performance tuning of Hadoop clusters and Hadoop workloads. • Screen Hadoop cluster job performances and capacity planning at application/queue level • Monitor Hadoop cluster connectivity and security • Manage and review Hadoop log files. • File system management and monitoring. • HDFS support and maintenance. • Diligently teaming with the infrastructure, network, database, application and business intelligence teams to guarantee high data quality and availability. • Collaborating with application teams to install operating system and Hadoop updates, patches, version upgrades when required.