Lead Data Engineer Job at WorkHQ, Los Angeles, CA

VHVzY3R6c1pYYjc4WWN1dmp4U25oL1h6YlE9PQ==
  • WorkHQ
  • Los Angeles, CA

Job Description

Company Context

Series A, well-funded US startup in HRTech developing WorkHQ.com and an AI Recruiter product.

This is a US-only, Remote role (Mainland).

Role Overview

Lead data infrastructure architect managing billions of data points across 250M+ professional profiles.

Hire data engineers to aid you in that journey.

Core Responsibilities

  • Design scalable data pipelines processing massive record volumes

  • Architect ETL processes using PySpark on Amazon EMR (Open to shifting to other solutions like Data Bricks / Snowflake)

  • Distribute enriched data through medallion architecture across Postgres, Athena, OpenSearch

  • Integrate new data sources into the main pipeline

  • Implement advanced data matching using Splink

Technical Requirements

  • 5-8 years professional data engineering experience

  • Good proficiency in:

    • PySpark and distributed computing

    • AWS data services (EMR, Glue, Athena)

    • Docker

    • Pandas and DataFrame manipulation

    • Complex data format handling (JSONL, Parquet)

  • Strong background in:

    • Big data processing architectures

    • Data warehouse design

    • Performance optimization

  • Advanced Python, SQL skills

Nice to Have

  • Probabilistic record linking expertise

  • OpenSearch/elasticsearch technologies

  • Machine learning data pipeline design

  • Recruitment tech ecosystem knowledge

Technical Stack

  • Big Data: PySpark, EMR

  • Databases: Postgres, OpenSearch

  • Cloud: AWS

  • Containerization: Docker

  • Data Formats: JSONL, Parquet

  • Analytics: Metabase, Athena, Glue

  • Data Processing: Pandas, Splink

Other Considerations

While this role has specific requirements - if you lack a few technical skills, but motivated to learn and lead the platform, please apply for consideration.

If you are coming from Director/Head of/VP levels that is relevant to this job, you can apply as well.

You will need to apply directly on our platform.

Thank you for your time.

Job Tags

Permanent employment, Shift work,

Similar Jobs

Option Care Health Inc.

Clinical Transition Educator / Registered Nurse - Per Diem - Lancaster Job at Option Care Health Inc.

 ...conditions in all 50 states. Through our clinical leadership, expertise and national scale,...  ...Description Summary: The Clinical Transition Educator is responsible for providing clinical...  ...Active and unrestricted Registered Nurse (RN) license required. Minimum of 2 years... 

Kaiser Permanente

Supervisor, Pharmacy Care Delivery, Acute Care Pharmacy Job at Kaiser Permanente

 ...responsible for: completing moderately complex tasks to achieve Pharmacy strategic priorities and goals across all inpatient pharmacy...  ...area; supervising, resolving, and guiding task completion for delivery of pharmaceutical care, service, and operations to utilize and... 

Trilogy

College Recruiter, Trilogy - $75,000/year USD Job at Trilogy

WARNING: This is not your typical recruiting job. Are you a high-energy talent magnet who thrives where others burn out? We need two exceptional...  ...," organizes with military precision, and navigates campus environments with natural authority. If you're energized by constant... 

Health Care for the Homeless

Medication-Assisted Treatment Nurse (MAT RN) Job at Health Care for the Homeless

 ...maintaining a roster of MAT participants and coordinating insurance prior authorizations. Coordinates care of clients within the agency, including...  ..., client education, review of preventive health needs and nursing assessments. Work in accord with the Baltimore City and... 

Lincoln Log LLC

Package Delivery Driver- Full-Time and Part-Time Job at Lincoln Log LLC

 ...lincolnlog.ohana Lincoln Log LLC's mission is to provide top-notch Amazon package delivery services with a focus on attention to detail and prioritizing the safety and well-being of our drivers. We are committed to creating an Ohana that is a supportive and secure...