Big Data Lead

Location: London, England Salary:
Sector: IT Type: contract

Big Data Lead, London, £375 per day:

My client is looking for a Big Data Lead, preferably based in the South East, the contract could well be rolling, rather than limited to 6 months

Job Description :

Primary Skills

  • Big Data-L2 (Mandatory)
  • Scala programming-L2 (Alternate)
  • Apache Kafka-L2
  • Apache Spark-L2
  • Experienced Big Data Developer with current and detailed knowledge and experience in real-time messaging systems using Spark Streaming, Event Messaging Systems (kinesis, kafka) and Big data sql engines like Presto/Impala (Mandatory), AWS EMR and related services (Preferable), Python or Scala (Mandatory)
  • Experience in optimizing read and writes into Big Data Sql engines (Preferable)
  • Experience of creating real-time data pipelines (Mandatory), productionising data science algorithms (Preferable), optimizing Spark jobs (Mandatory)

Experience in writing complex sql (Mandatory), plsql (non-essential).

If you are interested in this role and able to accept the £375 per day please apply with an up to date CV.

To find out more about Progressive Recruitment please visit

Progressive Recruitment, a trading division of SThree Partnership LLP is acting as an Employment Business in relation to this vacancy | Registered office | 1st Floor, 75 King William Street, London, EC4N 7BE, United Kingdom | Partnership Number | OC387148 England and Wales