Associate Director - AWS & Snowflake
Job Title: Associate Director - AWS & Snowflake
Career Level - F
Company
AstraZeneca is a global, innovation-driven biopharmaceutical business that focuses on the discovery, development, and commercialization of prescription medicines for some of the world's most serious diseases. But we're more than one of the world's leading pharmaceutical companies. At AstraZeneca, we're proud to have a unique workplace culture that inspires innovation and collaboration. Here, employees are empowered to express diverse perspectives and are made to feel valued, energized and rewarded for their ideas and creativity.
Department – Enterprise Data Engineering Service
The Enterprise Data Engineering Service exists to give our data citizens access to critical data and tools at pace and accelerating their work on life saving medicines. The service team actively collaborate with business partners to deliver cutting-edge data pipelines and self-service data management capabilities to fulfil AstraZeneca’s bold ambition of delivering life changing medicines. Our ambition is to build self-service data solutions and make enterprise data available so our business partners can focus on data product foundations for advanced analytics and insights.
Role
Through Enterprise Data Engineering Service, we are making our data Findable, Accessible, Interoperable and Re-usable (FAIR). As a Lead Data Engineer, you will lead the effort to bring about a step-change in our data solutions & capabilities and how we can facilitate secure collaborative environment to allow our data citizens performing pool analysis along with external partners. As part of this role, you need to provide the services and pipelines to ingest and consume data into/from the Data Platform, all in a secure and compliant way.
You will be involved in building out processes and technology to meet product owner requirements. You will be accountable for the efficient, secure, and compliant running of the solutions and capabilities. You should be well-versed in the design and development of data solutions and database developments for large data products, as well as maintaining and supporting production environments.
Essential Skills
Must have a B.Tech/ M.Tech/ MSc in Computer Science/ engineering.
Excellent experience in AWS data engineering ecosystem. SNS, SQS, Lambda, Glue, S3, EMR, log management, AWS containers, EC2, EBS, control access, data streaming, AWS CLI & SDK, backup & restore, etc.
Excellent experience in Object-Oriented programming (Java, Python, C#), Airflow, Apache Spark, source control (GIT) & versioning
Excellent experience in Snowflake tools and services
A strong understanding of databases and advanced SQL skills
Experience of designing self-service data management capabilities. E.g., Auto ingestion, data cataloguing, automated access control, life cycle management, backup & restore, etc.
Experience working in software engineering CI/CD processes, with experience in the design and implementation of applications automated test, build, release, deployment, containerization, and configuration control management.
Proven record of design, implementation, and performance tuning of large-scale data pipelines using any ETL & orchestration tools. E.g., Talend, informatica, Airflow, etc.
Experience of semi-structured (XML, JSON) and unstructured data handling including extraction and ingestion via web-scraping and FTP/SFTP.
Experience working with JIRA, Service Now
Experience of delivering solutions through Agile and SAFe
Key Accountabilities
Provide detailed design and implementation of capabilities such as, data share & collaboration environment, auto ingestion, data cataloguing, automated access control, life cycle management, backup & restore, etc.
Provide detailed design, aligned with the high-level design provided by Solution Architects. This includes, analysing data requirements, source data, model the source, and determine the best methods & tech stack for extracting, transforming, and loading the data into the data platform and processing the data through the layers of the data platform.
Implementation of optimal ETL workflows from wide variety of data sources using SQL, APIs, ETL tools, & AWS big data technologies.
Support solution development through leading & overseeing technical deliveries across multiple initiatives.
Providing technical input around design, architecture, integration, and support of the entire data sourcing platform with a focus on high availability, performance, scalability, and maintainability.
liaise with technical infrastructure teams to root cause & resolve problems and implement solutions to technical issues impacting application performance.
Liaise with architect, product owner, and business stakeholders to ensure sustainable efficient, secure, and compliant engineering and operation of data solutions & capabilities.
Engage with senior stakeholders for use case and high-level requirement gathering and running the workshops.
Collaborate with scrum master and the engineering leads to perform backlog/sprint management, prioritization, and PI planning.
Define engineering standards, processes, and roadmap in collaboration with solution architect and the service lead.
Collaborate with the service Lead in architecture team engagement for major changes and adjustments to platform blueprint and landscape.
Collaborate with international teams in UK, Sweden, US, Japan, India, and Mexico.
Test, document, and quality assess new data solutions, to ensure they are fit for release.
Research and Development aspirations to explore, actively support, and drive the consolidation of technology stack as well as work on new technology initiatives that best fit for purpose.
Know when to take initiative, speak up and are prepared to do so.
Have a “can do” approach to technical issues. Coaching and providing guidelines to the team members. Dig for the right technical answer that fits the need. Finding solutions to technical problems that may arise with understanding the technical issue and using all resources to solve that issue.
Build and support your teams through hiring, coaching, mentoring, feedback, and hands-on career development that helps drive high quality software delivery.
Perform regular quality checks, validation, and steering developers on design patterns and development best practices through comprehensive code/ design review sessions.
Estimation, implementation and delivery of features and functional enhancements within the platform that can support the improvement in value, revenue, profitability, and user satisfaction.
Provide the Service Lead with regular service performance metrics & maturity.
So, what’s next!
Are you already imagining yourself joining our team? Good, because we can’t wait to hear from you.
Where can I find out more?
Our Social Media:
Follow AstraZeneca on LinkedIn https://www.linkedin.com/company/1603/
Follow AstraZeneca on Facebook https://www.facebook.com/astrazenecacareers/
Follow AstraZeneca on Instagram https://www.instagram.com/astrazeneca_careers/?hl=en
AstraZeneca is an equal opportunity employer.
AstraZeneca will consider all qualified applicants for employment without discrimination on grounds of disability, sex or sexual orientation, pregnancy or maternity leave status, race or national or ethnic origin, age, religion or belief, gender identity or re-assignment, marital or civil partnership status, protected veteran status (if applicable) or any other characteristic protected by law.
AstraZeneca embraces diversity and equality of opportunity. We are committed to building an inclusive and diverse team representing all backgrounds, with as wide a range of perspectives as possible, and harnessing industry-leading skills. We believe that the more inclusive we are, the better our work will be. We welcome and consider applications to join our team from all qualified candidates, regardless of their characteristics. We comply with all applicable laws and regulations on non-discrimination in employment (and recruitment), as well as work authorization and employment eligibility verification requirements.
AstraZeneca embraces diversity and equality of opportunity. We are committed to building an inclusive and diverse team representing all backgrounds, with as wide a range of perspectives as possible, and harnessing industry-leading skills. We believe that the more inclusive we are, the better our work will be. We welcome and consider applications to join our team from all qualified candidates, regardless of their characteristics. We comply with all applicable laws and regulations on non-discrimination in employment (and recruitment), as well as work authorisation and employment eligibility verification requirements.
