New York,
NY
10002
United States
Posted: 01/10/2023
2023-01-10
2023-02-28
Job Number: z5G7h3l6a1kMvyS65NP3c-2NM0vUo-gqGjo1FcHeghk=
Pay Rate: N/A USD
Job Description
- 8to 10 years of experience in Data Engineering using Python along with Pyspark/Spark - MUST
- 3-5 years of experience in building big data solutions with pyspark, preferably in Data Analytics space – MUST
- AWS is must have
- Hands on in python data frame as well as Python factory design patterns
- Working knowledge in Spark and experience in spark data migration, restructuring and data partitioning
- Practical knowledge on NFRs – performance improvement in Partitioning and remodeling
- Hands on development experience in building distributed Big Data solutions including ingestion, caching, processing, consumption, logging & monitoring
- Strong technical communication skills
- Hands on Experience developing data engineering solutions in python using: S3, EMR, Glue, Athena, kafka and notebooks
Share This Job:
Login to save this search and get notified of similar positions.
