Big Data Hadoop Engineer - CR233
Location: Pleasanton, CAPosted On: 05/17/2022
Requirement Code: 58316
Requirement Detail
Position:Big Data Hadoop Engineer
Location: Pleasanton, CA
Duration: 12 Months Contract with Extendable
The Big Data Engineer shall lead the Big Data Engineering team. The consultant will play the role of technical lead and provide professional services to support the long term IT strategy and planning to include high level analysis, professional reports and presentations, and mentoring, support and training.
A. DELIVERABLES OR TASKS:
1. Provide vision, gather requirements and translate client user requirements into technical architecture.
2. Design and implement an integrated Big Data platform and analytics solution
3. Design and implement data collectors to collect and transport data to the Big Data Platform.
4. Implement monitoring solution(s) for the Big Data platform to monitor health on the infrastructure
Must Haves:
4-5 years of programming experience in Python, Java and Scala is must.
Strong experience with REST API development using Python frameworks (Django, Flask etc.)
Micro Services/Web service development experience using Spring framework
Experience with Dask, Numpy, Pandas, Scikit-Learn
Hands-on experience in Big Data, Cloudera Distribution 7.x, RDBMS