Senior Data Engineer

Job description

Thank You for reading this post! You rock! :)

 

We are SmartWays – we help people grow and make good career decisions. We are specialized in IT recruitment worldwide and encourage you to join our IT Talent Community!

We work with an international companies across the Globe, to drive their business outcomes with the best-in-class IT people. People who use their intelligence and passion to inspire their teammates and make an impact on our customers are highly valued by us. Please read this carefully to find out if this offer is for You.

Our Partner is one of the largest Public Relations agencies in the world. Polish office is one of over 120 branches operating in 81 countries and currently looking to hire a full-time Senior Data Engineer to build and maintain its analytics engine and support core capabilities. As a Senior Data Engineer, you would be directly involved with the product team including software engineers and data scientists, to build systems that elicit information from multiple data platforms in order to help identify relevant and actionable trends and/or concepts.

Requirements

You will be:

- Developing for and maintain internal ETL systems and big data processing applications

Building scalable data management solutions

- Supporting large-scale data loading and analysis efforts

Managing deployment of internal systems

- Streamlining and improving existing processes

Enforcing coding best practices & code reviews

 

We expect You to have:

- A general purpose programming language, preferably Python - Familiarity with Apache Spark and/or Dask

- A deploy management tool such as Ansible, Puppet, Chef

- Usage of Linux systems

- Distributed message queues

- 3+ years professional working experience on development teams

 

Nice to have: 

- Working within the Kubernetes ecosystem

- Pandas or similar data analytics toolkits

- Familiarity with distributed message queues

- Experience with large data management and data warehousing infrastructures

 

You can expect: 

- Possibility to have a real influence on the technological landscape of the project 

- Flexible working hours, with a possibility to work from home

- Full medical, dental, vision insurance

- Competitive salary