Connecting...

W1siziisimnvbxbpbgvkx3rozw1lx2fzc2v0cy9nb2xklwdyb3vwl2pwzy9iyw5uzxitzgvmyxvsdc5qcgcixv0

Data Engineer

Location: Portsmouth, Hampshire Salary: £400 - £500 per day
Sector: IT & Telecoms Type: Contract
Contact: Sam Francis Job Published: 21 days ago

Data Engineer

Duration / End Date: 31/03/2021

Clearance: SC

Location: Portsmouth 2-3 days/week, Horsham 2-3 days a week

Start Date: ASAP

Rate: £400-£500/day

Job Description: Working within the clients Data platform team to develop new features, prepare deployment packages, and support the Data Platform through its lifecycle

Responsibilities include:

  • Extending the existing client platform to support the ingest, storage, and egress of new data sets.
  • Supporting deployments of the platform
  • Identifying and improving current services

Required Skills: Core skills:

  • Familiarity with Agile methodologies
  • Working in a small, flat hierarchical team
  • Atlassian suite (JIRA, Confluence, Bitbucket)
  • Git (version control)

Essential Experience:

  • Building data ingest pipelines (NiFi, Bash script writing, Python, Scala)
  • Understanding of how the Hadoop ecosystem works
  • Connecting multiple CoTS and open source technologies together to produce a wider solution (Nifi, Kafka, Scala, GraphQL, HBase)
  • Containerising applications using Docker (Docker), the ability to write Dockerfiles and docker-compose.yml, and debugging Docker containers
  • Defining and developing APIs (Language agnostic)

Desirable Expereince:

  • Continuous integration/development processes. (inc. Apache Airflow)
  • Ingesting, storing and exposing image and/or video data.
  • Understanding of networking
  • Understanding of DeveOps Tools (Jenkins and Ansible)
  • Ability to use the Linux terminal (SCP, tmux, grep etc.)
  • Understanding of Spark
  • Using an IDE (IntelliJ, PyCharm)

Services advertised by Gold Group are those of an Agency and/or an Employment Business.
We will contact you within the next 14 days if you are selected for interview. Privacy Policy. Equal Opportunity and Diversity Policy.

Similar Jobs

Data Engineer

Horsham, West Sussex £500 - £550 per day

Data Engineer Duration / End Date: 31/03/2021 Clearance: SC Location: Portsmouth 2-3 days/week, Horsham 2-3 days a week Start Date: ASAP Rate: £500-£550/day Job Description: Working within the clients Data platform team to develop new features, prepare deployment pac...

Apply

GIS Data Manager

West Sussex, England £25000 - £50000 per annum

GIS Data Manager| Technology | West Sussex | Permanent | £25,000 - £50,000 pa My client, a technology company based in West Sussex are seeking a GIS Data Manager. This is a permanent role paying £25,000 - £50,000 pa. This role will involve extensive research, with a ...

Apply

Service Desk Engineer

Slough, Berkshire, S. E. England, England £180 - £200 per day

IT Service Desk Engineer Slough, Berkshire IT Service Desk Engineer needed for a leading organisation based in Slough, Berkshire, who are looking to employ an experienced IT Service Desk Engineer with an in-depth knowledge of Windows 7 / 10, Office 365, Active Direct...

Apply

Junior Dev/Ops Automation Engineer

Bromley, Kent, S. E. England, England £28000 - £32000 per annum + + Benefits

Junior DEV / OPS Engineer I am recruiting for a Junior DEV / OPS Engineer to join a very successful digital technology provider based in Bromley within the insurance and financial services sector who are looking for ambitious individuals to join a growing team. Benef...

Apply