SENIOR DATA ENGINEER
Progressive IT recruitment are on the lookout for a Senior Data Engineer to join one of the fastest growing start-ups product led SaaS Company. You will be their second specialised Data Engineer, working closely with the Principal Data Engineer, Head of Data & a team of Data Analysts.
At present, they have multiple data pipelines and you will have the opportunity to build that pipeline from scratch and will scale as the company expands. You will be responsible for expanding and optimising their data and data pipeline architecture, as well as optimising data flow and collection for cross functional teams.
* Create and maintain optimal data pipeline architecture, Assemble large, complex data sets that meet functional / non-functional business requirements.
* Identify, design, and implement internal process improvements: automating manual processes, optimising data delivery, re-designing infrastructure for greater scalability
* Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and AWS 'big data' technologies.
* Build analytics tools that utilize the data pipeline to provide actionable insights into customer acquisition, operational efficiency and other key business performance metrics.
* Keep their data separated and secure across national boundaries through multiple data centers and AWS regions.
* Advanced SQL knowledge and experience working with relational databases
* Experience building and optimizing data pipelines, architectures, data sets and strong analytical skills
* Build processes supporting data transformation, data structures, metadata, dependency and workload management
* Has worked with big data tools: Hadoop, Spark, Kafka, etc
* Commercial Experience with relational SQL and NoSQL databases, including Postgres and Cassandra
* Experience with AWS cloud services: EC2, EMR, RDS, Redshift
* Experience with object-oriented/object function scripting languages: Python, Java, C++, Scala, etc
* Above market remuneration packages
* Share Options
* Work Flexibility
To find out more about Progressive Recruitment please visit our website.
Award Winner for:
Best Medium Recruitment Company of the Year by Recruitment International 2018
Training & Development Initiative of the Year by Recruitment International 2018