Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9nb2xklwdyb3vwl2pwzy9iyw5uzxitzgvmyxvsdc5qcgcixv0

Data Engineer

Location: Horsham, West Sussex Salary: £500 - £550 per day
Sector: IT & Telecoms Type: Contract
Contact: Sam Francis Job Published: 19 days ago

Data Engineer

Duration / End Date: 31/03/2021

Clearance: SC

Location: Portsmouth 2-3 days/week, Horsham 2-3 days a week

Start Date: ASAP

Rate: £500-£550/day

Job Description: Working within the clients Data platform team to develop new features, prepare deployment packages, and support the Data Platform through its lifecycle

Responsibilities include:

  • Extending the existing client platform to support the ingest, storage, and egress of new data sets.
  • Supporting deployments of the platform
  • Identifying and improving current services

Required Skills: Core skills:

  • Familiarity with Agile methodologies
  • Working in a small, flat hierarchical team
  • Atlassian suite (JIRA, Confluence, Bitbucket)
  • Git (version control)

Essential Experience:

  • Building data ingest pipelines (NiFi, Bash script writing, Python, Scala)
  • Understanding of how the Hadoop ecosystem works
  • Connecting multiple CoTS and open source technologies together to produce a wider solution (Nifi, Kafka, Scala, GraphQL, HBase)
  • Containerising applications using Docker (Docker), the ability to write Dockerfiles and docker-compose.yml, and debugging Docker containers
  • Defining and developing APIs (Language agnostic)

Desirable Expereince:

  • Continuous integration/development processes. (inc. Apache Airflow)
  • Ingesting, storing and exposing image and/or video data.
  • Understanding of networking
  • Understanding of DeveOps Tools (Jenkins and Ansible)
  • Ability to use the Linux terminal (SCP, tmux, grep etc.)
  • Understanding of Spark
  • Using an IDE (IntelliJ, PyCharm)

Services advertised by Gold Group are those of an Agency and/or an Employment Business.
We will contact you within the next 14 days if you are selected for interview. Privacy Policy. Equal Opportunity and Diversity Policy.

Similar Jobs

Data Engineer

Portsmouth, Hampshire £400 - £500 per day

Data Engineer Duration / End Date: 31/03/2021 Clearance: SC Location: Portsmouth 2-3 days/week, Horsham 2-3 days a week Start Date: ASAP Rate: £400-£500/day Job Description: Working within the clients Data platform team to develop new features, prepare deployment pac...

Apply

GIS Data Manager

West Sussex, England £25000 - £50000 per annum

GIS Data Manager| Technology | West Sussex | Permanent | £25,000 - £50,000 pa My client, a technology company based in West Sussex are seeking a GIS Data Manager. This is a permanent role paying £25,000 - £50,000 pa. This role will involve extensive research, with a ...

Apply

Service Desk Engineer

Slough, Berkshire, S. E. England, England £180 - £200 per day

IT Service Desk Engineer Slough, Berkshire IT Service Desk Engineer needed for a leading organisation based in Slough, Berkshire, who are looking to employ an experienced IT Service Desk Engineer with an in-depth knowledge of Windows 7 / 10, Office 365, Active Direct...

Apply

Junior Dev/Ops Automation Engineer

Bromley, Kent, S. E. England, England £28000 - £32000 per annum + + Benefits

Junior DEV / OPS Engineer I am recruiting for a Junior DEV / OPS Engineer to join a very successful digital technology provider based in Bromley within the insurance and financial services sector who are looking for ambitious individuals to join a growing team. Benef...

Apply