Sr Azure Data Engineer Job at Cloudious LLC, Washington DC

UyswWXRqZ2JVcmZ3WjhpdmhoYW5odlA3YlE9PQ==
  • Cloudious LLC
  • Washington DC

Job Description

Job description

We are seeking a highly experienced and motivated Senior Data Engineer to lead the design development and optimization of data pipelines and architectures This role is critical in enabling scalable data solutions that support analytics reporting and machine learning initiatives across the organization

Key Responsibilities

Design build and maintain robust scalable and efficient data pipelines using tools such as Azure Data Factory Databricks and Apache Spark

Develop and optimize ETLELT workflows to ingest transform and store structured and unstructured data from various sources

Collaborate with data scientists analysts and business stakeholders to understand data requirements and deliver highquality datasets

Implement data governance quality and security best practices across all data engineering processes

Lead the integration of cloudnative data services eg Azure Synapse ADLS Azure SQL Cosmos DB into enterprise data platforms

Monitor and troubleshoot data pipelines and infrastructure to ensure reliability and performance

Mentor junior engineers and contribute to architectural decisions and code reviews

Participate in Agile ceremonies and contribute to sprint planning and delivery

Required Skills

Strong programming skills in Python SQL and Spark

Handson experience with Azure data services ADF Synapse Databricks ADLS and Azure DevOps

Deep understanding of data modeling warehousing and distributed computing

Experience with CICD pipelines and version control systems Git GitHub Actions

Familiarity with data lakehouse architecture and modern data stack principles

Strong problemsolving and communication skills

Preferred Qualifications

Bachelors or Masters degree in Computer Science Engineering or related field

Microsoft Certified Azure Data Engineer Associate or equivalent

Experience with MLOps Power BI and realtime data streaming Kafka Event Hubs

Exposure to data cataloging tools and metadata management

Job Tags

Similar Jobs

Compass Health Network

Nurse RN Outpatient Job at Compass Health Network

 ...frequent schedule changes and travels to neighboring clinics for nursing coverage and training Review medication education sheets...  ...medications received and dispensed Work to help complete prior authorizations Maintain list of injections, coordinate ordering and... 

Victor Valley College

Part-Time Faculty, Notary Public (Non-Credit) Job at Victor Valley College

 ...of transcripts showing college degrees and course-work. NOTE: Degrees must be from an accredited institution. *Applicants with foreign transcripts must have transcripts evaluated for U.S. equivalency by one of the following agencies. This evaluation must be completed... 

DEPENDABLE NURSES

Experienced ​Home Health RN for North Phoenix/Scottsdale Area Job at DEPENDABLE NURSES

 ...Home Health RN Flexible Hours, Real Impact Looking for Full-Time RN for the N Phoenix/Scottsdale area! Your Skills. Your Schedule. Your Impact. At Dependable Nursing , we believe that great nurses deserve flexibility, purpose, and support. Were hiring experienced... 

Colts Neck Reformed Church

Sanctuary Choir Director Job at Colts Neck Reformed Church

COLTS NECK REFORMED CHURCH Part time SANCTUARY CHOIR DIRECTOR Qualifications: Must have a faith firmly grounded in Jesus Christ Undergraduate music degree required Instrumental music background required Specific training in choral direction required...

Thrive

Client Support Engineer Job at Thrive

 ...Connectivity issues (per SOP) Time Sensitive and VIP Workstation incidents File Restores Remote Access/Onsite incidents (Citrix and Terminal Services) Password Resets Networked Printer Issues New PC installation including hardware, software and peripherals...