In-Demand IT Careers

Azure Data Engineer

Pittsburgh, PA

Posted: 03/11/2024 Job Category: Database Job Number: 6916

Job Description

OpenArc - Empowering Your Career. As a leading IT staffing firm, we are dedicated to connecting talented professionals with your ideal opportunities. We are currently seeking a qualified Azure Data Engineer to join our client’s organization and contribute to their ongoing success. 

 

Job summary

 The Azure Data Engineer will be responsible for designing, developing, and implementing data solutions on the Firms Azure Cloud platform.  They will play a crucial role in architecting and building scalable and high-performance data pipelines, ensuring the efficient extraction, transformation, and loading of data from various sources into the Firms Azure enterprise cloud data storage solutions. 

Responsibilities:

  • Automate data pipeline monitoring, error handling, and performance tuning to ensure data integrity and availability.  However, other members of the Digital Data Solutions Team or external consultants may be called upon to assist in troubleshooting issues with the pipelines.
  • Design, develop, and implement scalable and high-performance data solutions on the Azure or enterprise data platform.  More specifically, architect data pipelines and ETL processes to extract, transform, and load data from various sources into Azure data storage solutions.
  • Optimize data storage and retrieval mechanisms to ensure the efficient processing of large datasets.
  • Develop and maintain data models and schemas to support data analysis and reporting requirements.
  •  Implement data security and privacy measures to protect sensitive data.
  • Develop and maintain data ingestion processes to acquire data from various sources, including APIs, databases, and streaming platforms.
  • Implement data quality checks and validation procedures to ensure the accuracy and integrity of data.
  • Design and implement data transformation and enrichment processes using Azure Data Factory, Azure Databricks, or other relevant tools.
  • Document technical design, deployment processes, and best practices for data engineering solutions
  • Implement data partitioning, indexing, and optimization techniques to improve query performance.
  • Collaborate with data scientists and analysts to operationalize and deploy machine learning models on Azure.
  • Configure and manage data storage options including Azure Blob Storage, Azure Data Lake Storage, and Azure SQL Data Warehouse
  • Collaborate with DevOps teams to deploy and manage data engineering solutions in Azure.
 

Requirements:

  • Azure certifications, such as Microsoft Certified: Enterprise Data Engineer Associate, are a plus.
  • Preferred hands-on experience with Azure data services, including Azure Data Lake Storage, Azure SQL Database, Azure Data Factory, and Azure Databricks, Azure Synapse Data Warehouse.
  • Strong experience in data engineering and architecture, with a focus on Azure cloud technologies.
  • Proficiency in programming languages such as Python, SQL, and PowerShell.
  • Knowledge of data integration techniques and tools, such as ETL/ELT processes, data pipelines, and data warehousing concepts.
  • Familiarity with data modeling and schema design principles.
  • Understanding of data security and privacy regulations, including GDPR and CCPA.
 

At OpenArc, we prioritize your career success and strive to build exceptional technical teams for our clients. By understanding your experience and aspirations, we ensure to present you with rewarding and fulfilling opportunities. 

 

As an employee of OpenArc and our clients, you will be eligible to participate in a comprehensive benefits package.


OpenArc is an equal opportunity employer and will consider all applications without regards to race, sex, age, color, religion, national origin, veteran status, disability, sexual orientation, gender identity, genetic information or any characteristic protected by law.

Send an email reminder to:

Share This Job:

Related Jobs:

Login to save this search and get notified of similar positions.

WORK WITH US

alt
Get Connected
alt
GET EXPERT INSIGHT
alt
GET RESULTS
alt
GET OUR TEAM WORKING FOR YOU

Whether you are looking to fill or looking to advance your career, I would strongly suggest speaking to Scott and his team at OpenArc. Scott and his team provided a consultative and hands on approach throughout the entire process in my recent transition. Their unique approach was unlike anything I’ve experienced either as a candidate or a hiring manager.

-Mark Quinn, Service Sales Executive at Siemens Medical Solutions, USA, Inc.

Working with OpenArc was a great experience. The position I accepted was accurately described and my questions on benefits, paid time-off, and holidays and more were promptly answered. The entire OpenArc team was a very professional and to the point. I highly recommended OpenArc to all of my peers.

– Lisa McLaughlin, Executive Director, ACAPT

Take the Next Step