Background: One of the nation’s largest Healthcare systems seeks to hire a Senior Data Engineer within its newly created Azure Cloud Data Management team. Senior Data Engineer will be responsible for data processing and its transformation within Azure. Senior Data Engineers’ data wrangling skills will enable Data Scientists to perform advanced Analytics that will ultimately provide better care for patients.
What Will the Senior Data Engineer Do:
- be absolutely hands-on and provide strategic support on best practices with regards to data: ingestion, processing, transformation, and integration strategies within its Azure cloud data environment
- help build cloud architecture for collecting, storing, processing, and analyzing big data in batch and streaming pipelines
- develop, manage, and automate ETL processes and data pipelines to efficiently ingest data
- good knowledge of Azure cloud solutions and services (i.e. ADLS GEN2, Databricks, ADF)
- provide general guidance on data management, data warehousing, data modeling, data governance initiatives
- lead operational efforts to make the lives of Data Scientists easier by cleansing and aggregating data including productionalizing machine learning algorithms and BI reports
- lead the evaluation, implementation, and deployment of emerging tools and process for data engineering within a Data Science and Analytics environment
More Info – Senior Data Engineer Role:
- full-time role + 100% remote + great benefits
- Azure is a MUST + strong knowledge of Spark or Databricks
Responsibilities/Experience:
- experience as a Data Engineer within Azure with strong data ingestion skills i.e.: ETL, automation of data pipelines, batch / stream processing
- following tools / stacks are desired: Azure, SQL, Python, Spark, Databricks
- experience with Azure solutions and services: Azure Data Factory (ADF), Azure Data Lake (Gen1 / Gen2), Databricks
- healthcare experience is a plus