We are hiring: Hadoop Developer – 06-August-2026 US Remote
Hiring Organization: ClusterStream Dynamics
Client ID: 748QMTR
Job ID: 932LKPV
Role Overview
ClusterStream Dynamics is looking for a meticulous, technically proficient, and highly motivated Hadoop Developer to join our remote-first big data engineering team. In this full-time role, you will be responsible for designing, building, and maintaining robust data processing applications within the Hadoop ecosystem. We value deep understanding of HDFS, MapReduce, and cluster optimization. Whether you are an experienced big data developer or a talented fresher looking for a supportive environment to launch your career in large-scale data systems, we offer a mentorship-rich culture where your contributions will directly impact our cluster’s performance and reliability.
Key Responsibilities
- Develop and maintain scalable data processing jobs using MapReduce, Apache Spark, and Hive.
- Manage and optimize HDFS storage and data structures for efficient access and retrieval.
- Monitor and fine-tune YARN cluster resource allocation to ensure high job availability and performance.
- Build and optimize ETL pipelines within the Hadoop ecosystem for large-scale data transformation.
- Debug and resolve complex issues related to distributed data processing, job failures, and data bottlenecks.
- Collaborate with infrastructure and data science teams to optimize compute workloads.
- Participate in peer code reviews and architectural planning to maintain high engineering standards.
- Contribute to the continuous improvement of internal cluster deployment and automation workflows.
- Research and implement new Hadoop-related technologies (e.g., Impala, HBase, Oozie) to enhance capabilities.
- Document data processing logic, cluster configurations, and technical workflows for long-term maintenance.
Required Qualifications
- Bachelor’s degree in Computer Science, Software Engineering, or a related technical field.
- Strong proficiency in Java or Scala, with deep knowledge of the Hadoop ecosystem (HDFS, MapReduce, Hive, Pig).
- Solid understanding of distributed systems and parallel computing fundamentals.
- Experience with Apache Spark and its integration with Hadoop components.
- Familiarity with version control systems like Git.
- Excellent communication skills and the ability to work effectively in a remote, distributed team.
- A proactive, problem-solving mindset and a passion for working with large-scale data environments.
- Freshers with strong academic foundations in distributed systems or data projects are encouraged to apply; we provide extensive mentorship.
- Reliable high-speed internet connection for consistent, professional virtual collaboration.
Preferred Skills
- Experience with HBase or other NoSQL databases on Hadoop clusters.
- Knowledge of cluster management tools (Ambari, Cloudera Manager).
- Understanding of data modeling for big data (Star Schema, Partitioning strategies).
- Experience with automation and job scheduling (Oozie, Airflow).
- Familiarity with cloud-hosted Hadoop clusters (AWS EMR, Dataproc).
What We Offer
- Competitive Annual Salary: $182,450.
- 100% remote flexibility from any location in the United States.
- Comprehensive health, dental, and vision insurance packages.
- Retirement savings plan with company matching contributions.
- Generous Paid Time Off (PTO), including holidays and personal wellness days.
- Structured career development, mentorship, and support for professional certifications.
- A highly collaborative, inclusive, and mission-driven engineering culture.
Employment Details
Workplace Type: Remote
Location: United States (US)
Job Type: Full-Time
Employment Type: FULL_TIME
Employer Address: 800 ClusterWay, Suite 100, Atlanta, GA 30303
Freshers Can Apply: Yes
Standard Application Notice
ClusterStream Dynamics is an equal opportunity employer. We value diversity and are committed to creating an inclusive culture for all employees. All hiring decisions are based on merit, qualifications, and the business needs of the organization. Please submit your application using the form below.
