•Must have Cloudera Hadoop cluster deployment experience, including but not limited to deploying a Hadoop cluster, maintaining a Hadoop cluster, adding and removing nodes using cluster monitoring tool Cloudera Manager, configuring and upgrading the Cloudera Manager, CDH, CDSW and Kafka etc.
•Experience with relational SQL and NoSQL databases, including Teradata, Postgres and Cassandra.
•Hands-on experience with data delivery teams to setup new Hadoop users, including but not limited to setting up Linux users, setting up Kerberos principals and testing HDFS, Hive, Impala and Spark access for the new users.
•Perform installations, configurations, troubleshoot, performance tune, upgrade, backup and recovery of various Bigdata/Hadoop services such as HDFS, Hive, Impala, HBase, Spark, Kerberos.
•Must have Experience on Nifi in cluster deployment, including but not limited to maintaining, administrating, perform configuration change, perform upgrade, design & development of new data flows.
•Experience with big data tools: Hadoop, Hive, Spark, Kafka, etc.
•Strong hands on experience in implementation of Security like Kerberos, Sentry, OS Upgrade and TLS/SSL implementation.
•Experience in Cloudera platforms and workloads migration from On-premise to On-premise or On-premise to Cloud (Azure).
•Experience with data pipeline and workflow management tools: Nifi, Airflow, etc.