Background: eCommerce CPG leader seeks a Senior Data Engineer to join its Technology group. Data Engineer will be responsible for data processing and transformation so that it can be utilized for intelligent decisioning including business intelligence, marketing optimization, and gaining supply chain efficiencies.
What Will You Do:
- recommend optimal data ingestion, processing, transformation, and integration strategies within its hybrid Azure cloud and on-premise data environments
- develop, manage, and automate ETL processes and data pipelines to efficiently ingest data across many data sources
- collaborate on data management, data warehousing, data governance, data security initiatives
- lead operational efforts to productionize machine learning algorithms and business intelligence reports
More Info:
- full-time role can be done remotely preferably within the Northeast
Responsibilities/Experience:
- experience as a Data Engineer with strong data ingestion skills i.e.: ETL, automation of data pipelines, batch / stream processing
- proficiency with data ingestion tools like Python, Spark, SQL, SQL Server
- exposure to leading cloud platforms is a huge plus: Azure, AWS, GCP
- experience within Azure environment is a plus: Azure Data Factory (ADF), Azure Data Lake (Gen1 / Gen2), Databricks, Azure Synapse, Delta Lake)