Overview
Our customer is a unicorn and one of the global leading PSP’s that is processing hundreds of millions of payment transactions a day across all continents with near real time requirements based in
Amsterdam / NL.
They serve the world’s brightest companies like Meta, Uber, eBay, H&M, Microsoft and Spotify.
As they are reshaping the payments landscape we’re looking for Data Platform Engineers!
About the company & role:
Our customer provides payments, data, and financial products in a single solution, making them the financial technology platform of choice. Here, everything they do is engineered for ambition.
Sitting at the intersection of Data Engineering, Backend Engineering, and Systems Engineering, Data Platform Engineers build the foundational layer of tooling and processes for their on-premise Big Data Platforms. These tools support 10s of products, 100s of developers, and 1000s of daily jobs that add to their strong portfolio of capabilities.
You’ll collaborate with data engineers and ML scientists and engineers to build and roll-out these tools. Along with DataOps Engineers, you’ll develop and operate multiple big data platforms, of which the biggest is 500+ nodes, with 25k+ CPU cores, 240+ TBs of RAM, and 23+ PBs of storage capacity, running tens of thousands of spark jobs a day.
What you’ll do:
You’ll be asked to both build new tools and improve the existing tooling. This role is perfect for you if you’re passionate about few of the following:
● Develop and maintain scalable and high performance big data platforms.
● Work with distributed systems in all shapes and flavors (databases, filesystems, compute, etc.)
● Identify opportunities to improve continuous release and deployment environments
● Build or deploy tools to enhance data discoverability through the collection and presentation of metadata
● Introduce and extend tools to enhance the quality of our data, platform-wide
● Explore and introduce technologies and practices to reduce the time to insight for analysts and data scientists
● Develop streaming processing applications and frameworks
● Experience in infrastructure and large-scale private cloud systems
● For the currently open positions, the immediate focus will be the OLAP ecosystem (Druid, Clickhouse, Pinot), or the Data Engineering ecosystem (Data contracts, validations, optimization tooling, kafka ingestion tooling).
Who you are:
● Fluency in Python. An addition of Java, Golang, or Rust is also appreciated.
● Team player with strong communication skills
● Ability to work closely with diverse stakeholders you enable (analysts, data scientists, data engineers, etc.) and depend upon (infrastructure, security, etc).
● Experience developing and maintaining:
● Distributed data and compute systems like Spark, Trino, Druid, etc.
● Data modelling tooling
● DevOps pipelines and development ecosystems.
● Real-time and batch data pipelines (via Kafka, Spark streaming) with an eye for frameworks, and emphasis on user friendliness and quality.
● Kubernetes ecosystem (k8s, docker), and/or Hadoop ecosystems (Hive, Yarn, HDFS, Kerberos).
Salary and benefits
The salary is amongst the best in Amsterdam but depends on what you bring to the table in terms of skills, personality and experience.
Some of the secondary benefits: a permanent contract, 80% of your base stock option package, 12K annual allowance, healthcare, holiday allowance, holidays, laptop, travel allowance, training & conferences, 30% ruling, VISA sponsorship, solid relocation package, luxury in office lunch, snacks/drinks, work from home setup, etc.
Note: This role is based in the Amsterdam office. Our customer is an office-first company and values in-person collaboration; they do not offer remote-only roles.
