Data Engineer

As Data Engineer at Ematiq you will be working on systems ingesting terabytes of real time data in mission critical pricing pipelines.

Ideal candidates possess the ability to gather requirements from business about newly acquired or important sources of data, then design and implement these pipelines with proper operational and reliability aspects in mind, meeting data quality / timeliness requirements. Spark, Apache Flink, Apache Beam or other data handling technology experience is also very welcome.

Architectural skills are of great value as we expect the right candidate to own and lead design phases of the pipeline delivery as well as having vision for its evolution in alignment with our business needs.

We are very open to giving lots of autonomy and trust to right candidates in terms of particular technology stack supporting our data engineering efforts. 

We are already using TimescaleDB and expect candidates to have enough engineering experience to qualify and disqualify proper storage technologies as well.

Scripting experience in Scala / Python will be definitely of immediate value, we are also open to experiment with other data engineering stacks and technologies that could move us towards mature data engineering practices.

What will be your daily responsibilities?

• designing, implementing and supporting data ingestion pipelines and data integration scenarios in AWS cloud environment
• owning data quality and validity checks
• influencing our data modeling practice based on acquired domain knowledge
• improving stability, timeliness and reliability of our data ingestion pipelines
• coordinating with our CTO on picking proper technological candidates in alignment with our technical strategy
• steadily improving quality of data engineering competence, ideally by leading by good example in terms of evaluating and applying modern data engineering trends
  
  

Our core stack

• Scala / Python 3
• Kafka
• TimescaleDB
• AWS