As a Data Operations Engineer, you are responsible for hands-on maintenance of the day-day operations for the firm’s Azure and Power BI-based Enterprise Data Architecture. Responsibilities include the processing and movement of data from source through the Data Lake, Data Warehouse, to consuming systems.

Responsibilities, Duties & Accountabilities;

The role will be to support the firm’s day-to-day data operations while working on projects to enhance functionality and reliability of the overall data infrastructure. This role will work cross-functionally, so must be process-minded and collaborative. Key stakeholders include other data team members, IT Infrastructure, Product Management, Project Management, and external providers. The role will work alongside with Database Developers, Data Analysts, and Data Architects.

This position has an emphasis on production support work, but it requires collaboration with business stakeholders, developers and third-level support.

• Troubleshoot and resolve technical issues with data migration and transformation within the Microsoft Azure environment such as Data Factory, Synapse, bespoke code, and other applications in the Development. Test and Production environments. Perform production deployments.
• Ensure the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle, especially from Data Lake through downstream data delivery and reporting
• Collaborating with data engineers related to optimizing application logic and functionality in the Azure Gen2 Data Lake, Data Factory, Synapse and SQL Database environment.
• Working knowledge of the firm’s data warehouse schema.
• Troubleshoot issues and propose solutions.
• Apply proven communication and problem-solving skills to resolve support issues as they arise

Requirements;

The ideal candidate will have served in a data engineering, cloud-based data architecture, or DevOps role previously.

Other qualifications include:

• Demonstrated experience monitoring and optimizing data architectures
• In-depth understanding of data management (e. g. permissions, security, and monitoring).
• Experience with scripting languages such as SQL, Python, Power Query.
• Knowledge of software development best practices.
• Expertise in database development projects and ETL processes.
• Experience with Microsoft Azure Data Lake, Data Factory, Synapse and SQL Database products
• Experience with Power BI
• An understanding of AI/ML applications is a plus.
• Quality assurance for both On-line Transaction Processing (OLTP) and On-line Analytical Processes (OLAP) database systems.