Search jobs

Python Pyspark Developer

New York, NY 10002

Posted: 01/10/2023 Job Number: z5G7h3l6a1kMvyS65NP3c-2NM0vUo-gqGjo1FcHeghk= Pay Rate: N/A USD

Job Description

  • 8to 10 years of experience in Data Engineering using Python along with Pyspark/Spark - MUST
  • 3-5 years of experience in building big data solutions with pyspark, preferably in Data Analytics space – MUST
  • AWS is must have
  • Hands on in python data frame as well as Python factory design patterns
  • Working knowledge in Spark and experience in spark data migration, restructuring and data partitioning
  • Practical knowledge on NFRs – performance improvement in Partitioning and remodeling
  • Hands on development experience in building distributed Big Data solutions including ingestion, caching, processing, consumption, logging & monitoring
  • Strong technical communication skills
  • Hands on Experience developing data engineering solutions in python using: S3, EMR, Glue, Athena, kafka and notebooks

Apply Online

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.