DESCRIPTION:
We are looking for an Lead Data Engineer to join our client’s team on a subcontract basis.
Should have:
- 7+ years of experience coding in SQL, Python with solid knowledge of data structures and algorithm design
- Strong knowledge of DBT
- 2+ years of experience working with Snowflake
- 1+ year of working with Databricks
- 3 years of experience in Azure
- hands-on implementation experience working with a combination of the technologies like this: Spark, Kafka, SQL and NoSQL data warehouses
- experience in data migration, in particular, to Snowflake cloud Data warehouse
- 1+ year of technical team leadership experience
- Knowledge of professional software engineering best practices for the full software
- Knowledge of Data Warehousing, design, implementation and optimization
- Knowledge of BI reports and dashboards design and implementation
- Knowledge of development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations
- Experience participating in an Agile software development team, e.g. SCRUM
- A consistent track record of delivering exceptionally high quality software on large, complex, cross-functional projects
- Demonstrated ability to learn new technologies quickly and independently
- Ability to handle multiple competing priorities in a fast-paced environment
- Undergraduate degree in Computer Science or Engineering from a top CS program required. Masters preferred
- Experience with supporting data scientists and complex statistical use cases highly desirable
- Strong interpersonal and communication skills
- English — Upper-intermediate
- Location — London, United Kingdom (necessity to visit office, 50/50%)
Nice to have:
- Understanding of cloud infrastructure design and implementation
- Experience in data science and machine learning
- Experience in backend development and deployment
- Experience in CI/CD configuration
Responsibilities:
- Responsibilities will include technical delivery review, resolution of architecture issues and for the migration of the existing on-premises application to Snowflake platform
- Contributes design, code, configurations, and documentation for components that manage data ingestion, batch processing, data extraction, transformation, and loading across multiple data storages
- Owns one or more key components of the infrastructure and works to continually improve it, identifying gaps and improving the platform’s quality, robustness, maintainability, and speed
- Interacts with engineering teams and ensures that solutions meet customer requirements in terms of functionality, performance, availability, scalability, and reliability
- Performs development, QA, and dev-ops roles as needed to ensure total end to end responsibility of solutions
- Leading small team of data engineers working on data migration for our customer
We offer:
- The full-time workload on a remote basis
- Start — April 3, 2023
- Duration — 3+ months
- Interview — internal technical interview
If you think you are the right person, we’d welcome your application!
