portal resources jobs companies d didomi senior data engineer

Senior Data Engineer 🔥


Didomi (didomi.io) helps companies get in compliance with data privacy regulations like GDPR and CCPA. We build a consent management platform that consists of apps, web components, and APIs around collecting, sharing and managing user consents. We know privacy appears to be a boring and hard problem, but we strive to make it interesting and easy to solve for our clients.

We are looking for a senior software engineer with a focus on data engineering to join our team of 10+ people. While our main office is in Paris, we are a very distributed team and are open to people working remotely all around the world.

What you will do

Leveraging your experience in building and maintaining complex data pipelines, you will drive the development of our analytics platform currently built on AWS Firehose, S3 and EMR / Python / Spark / PostgreSQL.

We are looking for someone who is eager to:

- Collaborate with other developers to ship new features

- Be in charge of the overall architecture of data pipelines

- Ensure that we have the right tests and structure in place to make sure that we can move quickly without breaking everything

- Share his/her knowledge of data engineering principles and best practices with the team

- Keep learning new technologies and be on the look-out for new ideas that we should try out

What we are looking for

- A Spark expert

- Experience with complex data pipelines in the Cloud

- Quality-oriented mindset: testing, code reviews, code quality, etc.

- Awareness of performance considerations

- A passion for simple, maintainable and readable code that balances pragmatism and performance

How do we build our products?

We process millions of events every day and are building our analytics platform on Kinesis Firehose / S3 / EMR, with Python/Spark and PostgreSQL to provide an easy-to-use platform for querying and graphing events to everyone in the company and outside.

Most of our front-end applications rely on Angular 2+/Material/Redux. We love Angular but sometimes we need lightweight applications that can be embedded on thousands of websites so we also use Preact/Redux Zero for that.

We also build mobile SDKs for Android and iOS for our clients to embed in their apps.

Our back-end applications use Feathers JS, an amazing service-oriented Node.js framework for building REST and GraphQL APIs. We try to keep our services small and lean and use AWS Lambda/Serverless for background jobs. We leverage PostgreSQL and DynamoDB as our main databases.

We rely on a lot of AWS/GCP services (Beanstalk, Lambda, CloudWatch, S3, etc.) for building, deploying, serving, monitoring and scaling our services. We use Gitlab for our code and issues and our CI.

Our vision as a team

We are building a product and engineering team that is strongly committed to a high level of quality in our products and code. We believe that automation is the key to consistently achieving that along with velocity of development and joy and pride in what we deliver.

We rely on automated tests of all sorts (unit, integration, linters, you-name-it!) and continuous integration/delivery to build flexible applications that are able to evolve without breaking. We trust that it enables engineers to focus on the quality of their code and iterate fast without fears of breaking stuff. And when we break stuff, we fix it and learn from our mistakes.

Recruitment Process

Our interview process usually includes interviews with tech and non-tech people and a practical exercise/discussion like a code challenge, a code review or an architecture design. We understand you already have a job, obligations (and maybe a personal life!) so we'll work with you to make sure it doesn't take up too much of your time while still providing a good basis for a very concrete discussion.

We hope that you like what you are reading here. You are just one step away from getting started with us! Apply here and we'll be in touch within 24 hours.

Other openings you might be interested in

More remote jobs

Let us send you new openings similar to Senior Data Engineer straight to your Inbox. Weekly or Daily. 7-day free trial đź’Ś

The ability to work remotely increases employee happiness by 20 percent.