Job Description

Global hospitality company is looking for an experienced Lead PySpark Data Engineer for their Midtown NYC headquarters.

Responsibilities :

• Lead the in-house development of ETL/ELT data pipelines and data science projects.
• Create and own data products, such as a recommendation engine or predictive model.
• Provide key insights and analyses to senior stakeholders and executives.
• Work with the Data Engineering team to design and develop data models.

Qualifications And Requirements

• 5+ years of relevant professional experience in building AWS big data pipelines using Apache Spark.
• Strong hands-on experience with programming in Python.
• Expertise in SQL and analytical data modeling.
• Hands-on experience in pipeline orchestration tools, like Apache Airflow.
• Experience in PostgreSQL, Redshift, S3, AWS Lambda, Kinesis and Athena.
• Previous work with cloud-based BI tools (such as Looker, and Quicksight) is a plus.
• Strong organizational, problem-solving, and communications skills (must be able to do basic technical writing)

Job Tags

Similar Jobs