LEAD DATA ENGINEER (AWS)
Poland
LEAD DATA ENGINEER (AWS)
Godel is on the constant lookout for talented Lead Data Engineer to join one of our teams engaged in development of business applications for major British companies. We always have new and exciting projects with opportunities to improve your skills in a wide spectrum of technologies related to web development. If you are enthusiastic and ambitious developer, willing to take active participation in shaping of a product, this job is for you!
Godel Data Division
These are just some of the technologies that you might work with at Godel Data Division:
- Data Integration: Apache Airflow (MWAA)
- Data Processing: Apache Kafka (MSK), Apache Spark (EMR), Amazon Kinesis, AWS Batch
- Database & Data Warehouse: Amazon DynamoDB, Amazon Redshift, Amazon Athena
- Storage: Amazon S3, Amazon Glue
- Talent Management
- Talent Acquisition
- Education
- Innovations
- Onboarding
- Consultancy
Responsibilities
- Technical requirements elicitation
- Providing technical leadership for the customer
- Consult and collaborate with team members
- Design and development of data platform (data lake) based on cloud services from AWS
- Developing batch & stream data processing solutions, ETL processes, automated workflows
- Testing data pipelines and data quality using modern approaches
- Implementing industry’s best practices for collecting, transforming and accessing data
- Code review
- Communication with the customer and working directly with the Customer team
- Working within an agile team
Requirements
Ideally you have:
- Strong knowledge of AWS Cloud platform and desire to work with the following services: Amazon S3, EC2, ECR, AWS Batch, Amazon DynamoDB, Amazon Athena, Amazon Redshift
- Deep experience of working with data pipelines: ETL/ELT, Data Quality and Data Management. Preferable technologies like: Apache Airflow, Apache Kafka, Apache Spark
- Good knowledge in at least one of the programming languages Python, Java
- Excellent communication and negotiation skills
- Exposure to operation of business-critical data products
- CI/CD: Git, Terraform, Jenkins, Test driven approach (TDD/BDD)
- Metrics and Notifications: Prometheus, Grafana
- Enthusiasm for agile and lean development
WHAT WE OFFER
Having fun and delivering the very best service are the founding principles of Godel.
We’re always on the lookout for talented and creative people who are willing to go above and beyond the call of duty for their teammates and our clients.
Working for Godel comes with a range of benefits to help you to enjoy your work here, including:
Flexible Working Schedule and Hybrid Way of Work
Agile Delivery
We use agile because it's cool. It suits everyone
Challenging Projects
It could be the travel or energy industry, a mobile app or an in-house analytics service
Professional Team
Our clients come to us from a wide variety of industries
Trust-Focused
Culture
Private Medical Healthcare for You and Your Family
Group Life Insurance for You
Multisport Card
Free English / Polish Classes
Loyalty Program
Personal Development Plan
