Big Data Administrator

·      Administer and manage Redis clusters for low-latency caching and real-time transaction processing. ·      Manage MongoDB clusters (replication, sharding) for scalable transaction and semi-structured data storage. ·      Working knowledge of Hadoop ecosystem (Hadoop, Hive, Pig, Oozie, Hbase, Flume, sqoop) using both automated tool sets as well as manual processes. ·      Support and maintain Hadoop (HDP)clusters for batch processing, analytics, and regulatory reporting. ·      Perform cluster lifecycle management provisioning, scaling, patching, and decommissioning nodes. ·      Ensure 24x7 availability and resilience of production systems supporting payment flows. ·      Manage and optimize Apache Kafka for high-throughput, real-time payment event streaming. ·      Support Apache NiFi for ingestionpipelines from upstream payment systems and external partners. ·      Work with AWS EMR for scalableprocessing of transaction data and reconciliation workloads. ·      Administer HDFS, ensuring optimal replication,storage utilization, and fault tolerance. ·      Manage OpenSearch / Elasticsearchclusters for transaction search, audit trails, and operational dashboards. Required Skills & Experience ·      6–8 years of experience in Big Data / DataPlatform Engineering in enterprise environments. ·      Strong hands-on experience with: ·      Hadoop ecosystem (HDFS, YARN, MapReduce, HDP) ·      Apache Kafka (high-throughput environments) ·      Redis and MongoDB clusters ·      OpenSearch / Elasticsearch ·      Apache NiFi ·      AWS EMR + good knowledge of AWS Cloud. ·      Strong expertise in Linux system administration and scripting (Shell/Python) ·      Experience with Kerberos, data security, and access governance ·      Proven experience in handling high-volume, low-latency systems (preferably payments/trading)

EA License No: 11C4879 / Registration ID : R1218583 Apar Technologies Pte Ltd, Singapore