Hadoop Platform Engineer Job at RAMPS International Inc., San Jose, CA

ZUJzZnE5Vy9qUE4xWkRSQjNUdWZMZnFLR3c9PQ==
  • RAMPS International Inc.
  • San Jose, CA

Job Description

Job Description

Job Description

Hadoop Platform Engineer
San Jose, CA
4-12 Months

Position summary
The Data and Analytics Platform team resides within Adobe's Information and Data Services team and we are looking for a Hadoop Platform Engineer who will be responsible for the implementation and ongoing administration of Hadoop infrastructure including designing, deploying, monitoring, tuning and troubleshooting.

Job Responsibilities
Responsibilities:
• Design and develop different architectural models for our scalable data processing as well as scalable data storage
• Build data pipelines and ETL using heterogeneous sources
• Build data ingestion from various source systems to Hadoop using Kafka, Flume, Sqoop, Spark Streaming etc.
• Transform data using data mapping and data processing capabilities like MapReduce, Spark SQL
• Supports Big Data and batch/real time analytical solutions
• Own the platform architecture and drive it to the next level of effectiveness to support current and future requirements
• Design, implement, deploy and maintain security, data capacity, node forecasting and planning.
• Provide hardware architectural guidance, plan and estimate cluster capacity, and create roadmaps for the Hadoop cluster deployment.
• Closely work with the Hadoop development, infrastructure, network, database, and business intelligence teams.
• Participate in a 12x7 rotation for production issue escalations.
• Communicate effectively with people at all levels of the organization.

Requirements:
• B.S. degree in Computer Science, Electrical and Computer Engineering, or equivalent technical fields.
• Experience in tools integration, automation, configuration management systems.
• Experience with networking, systems administration skills.
• 3+ years of hands on working experience on Hadoop infrastructure stack (Ex: HDFS, MapReduce, HBase, Flume, Spark, Pig, Hive, Oozie, YARN, Zookeeper, Presto, etc). 2+ years of experience in Python or Perl.
• MapReduce, Hbase, Hive, Impala, Spark, Kafka, Kudu, Solr)
• Strong development/automation skills. Must be very comfortable with reading and writing Scala, Python or Java code.
• Proven Ability to build Curated Models for BI and Analytics
• Strong SQL Skills

Best regards,

 
Sridhar P
Senior Recruiter | RAMPS International, Inc
1199 Amboy Ave, Suite 2F, Edison, NJ 08837
email: [email protected] |url:

Job Tags

Work experience placement,

Similar Jobs

Trillium Transport DBA Horizon Freight System

Intermodal Trucking Dispatcher Job at Trillium Transport DBA Horizon Freight System

 ...Job Description Job Description Intermodal Dispatcher Job Summary: The Intermodal Dispatcher is responsible for the coordination...  ...and operational support team. Responsibilities: Monitor truck drivers Hours of Service, ensuring compliance with all federal... 

OMI Group

Brand Ambassador Job at OMI Group

 ...Optimist Management Group we specialize in connecting major brands with their customers through authentic human interaction. Our...  ...We are seeking enthusiastic, outgoing, and driven Brand Ambassadors to represent Optimist Management Group in the Pittsburgh area.... 

Pace Center for Girls, Inc.

Executive Director Job at Pace Center for Girls, Inc.

 ...succeed and break generational cycles of poverty and violence. Pace is currently seeking an exceptional leader to serve as our Executive Director. The right person will be committed to the long-term success of the program and possess a passion for our mission. In this... 

The Judge Group

Food Safety Supervisor (Florence) Job at The Judge Group

 ...Job Title: FSQA Supervisor Department: Food Safety & Quality Assurance Location: Florence, SC (Relocation expenses paid for) Reports To: FSQA Manager / Quality Assurance Manager Key Responsibilities: Supervise FSQA technicians and ensure proper execution... 

Sanford Health

Pharmacy Technician - Infusion Pharmacy | Bemidji - Full Time Job at Sanford Health

 ...Department Details We are seeking a dedicated pharmacy technician to join our infusion pharmacy team, supporting both cancer...  ...Daily Duties: - This role includes sterile compounding using aseptic techniques in a cleanroom environment....