- Build and maintain data pipelines and DAG workflows in Airflow
- Prepare and transform data for analytics and business use cases
- Work with ClickHouse and MySQL, optimize queries, and analyze query execution plans
- Integrate with partner services and external data sources via APIs and FTP
- Design and develop microservices for data processing
- Work with high-load systems processing terabytes of data
- Contribute to architecture and propose technical solutions to improve performance and scalability
Requirements
- 5+ years of professional Python development experience
- Strong SQL skills and hands-on experience with query optimization
- Experience with ClickHouse and/or MySQL
- Experience designing Python frameworks and libraries, as well as profiling and performance optimization
- Experience developing and working with OLAP systems
- Hands-on experience with Airflow, Pandas, Kafka and/or RabbitMQ
- Experience retrieving and processing data via APIs and FTP
- Experience with Docker and Kubernetes
- Ability to independently evaluate and choose technical solutions
- The opportunity to work on large-scale products and contribute to their development
- A flexible work environment built on autonomy, ownership, and trust, without micromanagement
- The option to work fully remotely or from a modern office
- Medical insurance coverage in countries where the company operates
- An annual $2,000 benefits allowance after the probation period, which can be used for health insurance upgrades, language learning, and sports activities
- Partial reimbursement for professional training, courses, and participation in industry conferences
- Access to a corporate digital library
- Company-funded weekly online sessions with a psychologist
- Relocation opportunities to countries where the company has offices, with relocation assistance available after the probation period, subject to approval
Data Engineer IT & Data Development in Newcastle employer: 01.tech
At 01.tech, we pride ourselves on being an exceptional employer that fosters a collaborative and innovative work culture. Our remote environment allows for flexibility while providing ample opportunities for professional growth and development, ensuring that our team members can thrive as they tackle high-load data challenges on a global scale. Join us to be part of a dynamic team that values your expertise and encourages meaningful contributions to impactful projects.
