Duration: 10 months to start
Job Description:
The client is looking for a highly skilled and experienced candidate to fill the Senior Cloud Data Engineer position for Data Modernization Initiative (DMI) Projects.
- The client is executing large-scale data modernization across the agency as part of DMI. This includes creating a consolidated Enterprise Data Platform on modern cloud tools (including AWS & Snowflake,) and re-platforming existing business data applications from solutions such as SAS and legacy databases to the new platform.
- The client data systems enable epidemiologists, public health researchers, state and local public health officials, and business leaders to analyze public health trends and drive policy decisions.
- The ideal candidate is an expert in Design and implementation of Data pipelines in both centralized and decentralized Data architectures.
- You can clearly articulate and implement different data ingestion patterns depending on use case.
- In this role, you are comfortable speaking to both business and technical stakeholders to ensure combined understanding and collaborative solutions.
- This role will be expected to own tasks and follow-up related to cloud data platform Design and development activities and establish well documented best practices and processes related to the Data Modernization efforts.
Duties and Responsibilities:
- Involve in Design and development of cloud-based data management systems.
- Proficiency and practical experience in Design and implementation of data pipelines in both centralized and decentralized Data architectures.
- Ensures established data security policies and standards are followed while designing data solution for cloud-based platforms.
- Collaborates with cross-functional teams to architect highly scalable, highly available, and highly performant cloud data solutions.
- Evaluates and recommends new cloud products and services for efficient data curation, storage and processing.
- Monitors the performance of cloud data solutions and strategizes optimization measures.
- Ensures compliance with data governance policies and best practices in the cloud.
- Implements data management and data governance processes for cloud data.
- Conducts thorough analysis and documentation of cloud data engineering strategies and designs.
- Establish regular overall system performance assessment processes and action plans.
- Expertise in Data Integration leveraging Informatica (IICS), Snowflake, SQL and Python code to solve complex use cases
- Provide direction for the design and development of the data layers including review of ETL requirements.
- Capable of leading team design sessions and facilitating decisions.
- Ensure timely delivery of solutions meeting requirements and expectations
Qualifications:
Minimum Experience/Skills:
- 5+ years of experience in Design and development of Data pipelines, Cloud Data Architecture, Data warehousing, Data modeling, ETL, enterprise and business information system architectures, and system engineering
- Thorough knowledge and Implementation experience of data warehouse and Enterprise Data architecture principles, specifically Decentralized data architectures like Data Mesh.
- 3-5 years of experience developing Cloud-based (AWS) data solutions.
- 5+ years of Cloud database platform experience such as Snowflake.
- Experience in creating and maintaining end-to-end data pipelines.
- Strong communication skills comfortable explaining/proposing solutions to technical stakeholders, vendors, and business consumers.
- Proficiency with Unix, Linux, and shell scripting
- Experience working with a large, multi-terabyte enterprise data platform in Cloud.
- Clear understanding on system administration, database administration, storage architectures, backup & recovery, and networking.
- 3-5 years of experience in Informatica (IICS) ETL, GitHub(CI/CD) and Airflow (Orchestration) experience.
- Experience working with highly sensitive health care information and familiar with HIPAA and other data privacy controls.
Preferred Experience/Skills:
- Amazon Web Services (AWS) Certification or Cloud Data Engineer Certification
- Informatica (IICS) and Airflow (Orchestration) experience
- Snowflake certification
- Tableau and/or Power BI reporting experience
#LI-Hybrid
