Data Platform Engineer

What you'll do...

• Build and optimise the platform used by the data team to transform raw data into business insights
• Scope and deliver new data engineering projects in collaboration with business stakeholders
• Develop and deploy ML infrastructure to help build out our ever-growing AI requirements and use cases
• Research and implement new tooling where appropriate, whether its developed in-house or sourced externally
• Maintain and expand our existing data infrastructure and tools.
• Consult the wider business on Engineering best practices and stay up to date with trends within the profession
• Support the internationalisation of our data infrastructure as we continue to grow globally.

What you'll have...

• Primarily, we want our DevOps engineers to have a passion for writing high quality code and building lean processes. It would be helpful to have experience/expertise/knowledge in the following (in rough priority order):


• AWS
• Kubernetes (EKS)
• Data/network security
• Python
• Docker
• Grafana
• Postgres
• CDC systems
• Data related products (airflow, jupyter, spark, etc)


The projects will be varied and we’re looking for someone who can work autonomously and proactively to scope problems and solve and deliver pragmatic solutions

Our Tech Stack...

• Python as our main programming language
• Terraform on Spacelift for our infrastructure definition and deployment
• Kubernetes for data services and task orchestration
• Airflow for job scheduling and tracking
• Circle CI for continuous deployment
• Databricks for our data lake platform
• Parquet and Delta file formats on S3 for data lake storage
• Postgres / aurora for our relational databases
• Spark for data processing
• dbt for data modelling
• SparkSQL for analytics
• Streamlit for data applications

💚 Why else you'll love it here

• 💰 Wondering what the salary for this role is? Just ask us! On a call with one of our recruiters it's something we always cover as we genuinely want to match your experience with the correct salary. The reason why we don't advertise is because we honestly have a degree of flexibility and would never want salary to be a reason why someone doesn't apply to Octopus - what's more important to us is finding the right octofit!
• 🎉 Octopus Energy Group is a unique culture. An organisation where people learn, decide, and build quicker. Where people work with autonomy, alongside a wide range of amazing co-owners, on projects that break new ground. We want your hard work to be rewarded with perks you actually care about! We won best company to work for in 2022, on Glassdoor we were voted 50 best places to work in 2022 and our Group CEO, Greg has recorded a podcast about our culture and how we empower our people. We’ve also been placed in the top 10 companies for senior leadership
• 🎁 Visit our UK perks hub - Octopus Employee Benefits