Data Engineer

Location: Portsmouth, Hampshire Salary: £400 - £500 per day
Sector: IT & Telecoms Specialism:
Type: Contract Contact: Sam Francis

Data Engineer

Duration / End Date: 31/03/2021

Clearance: SC

Location: Portsmouth 2-3 days/week, Horsham 2-3 days a week

Start Date: ASAP

Rate: £400-£500/day

Job Description: Working within the clients Data platform team to develop new features, prepare deployment packages, and support the Data Platform through its lifecycle

Responsibilities include:

  • Extending the existing client platform to support the ingest, storage, and egress of new data sets.
  • Supporting deployments of the platform
  • Identifying and improving current services

Required Skills: Core skills:

  • Familiarity with Agile methodologies
  • Working in a small, flat hierarchical team
  • Atlassian suite (JIRA, Confluence, Bitbucket)
  • Git (version control)

Essential Experience:

  • Building data ingest pipelines (NiFi, Bash script writing, Python, Scala)
  • Understanding of how the Hadoop ecosystem works
  • Connecting multiple CoTS and open source technologies together to produce a wider solution (Nifi, Kafka, Scala, GraphQL, HBase)
  • Containerising applications using Docker (Docker), the ability to write Dockerfiles and docker-compose.yml, and debugging Docker containers
  • Defining and developing APIs (Language agnostic)

Desirable Expereince:

  • Continuous integration/development processes. (inc. Apache Airflow)
  • Ingesting, storing and exposing image and/or video data.
  • Understanding of networking
  • Understanding of DeveOps Tools (Jenkins and Ansible)
  • Ability to use the Linux terminal (SCP, tmux, grep etc.)
  • Understanding of Spark
  • Using an IDE (IntelliJ, PyCharm)

Services advertised by Gold Group are those of an Agency and/or an Employment Business.
We will contact you within the next 14 days if you are selected for interview. Privacy Policy. Equal Opportunity and Diversity Policy.

Similar Jobs

Data Consultant

Horsham, West Sussex £60000 - £65000 per annum + Benefits

Network Engineer

Amsterdam, North Holland €48 - €50 per hour

Software Engineer

Reigate, Surrey £60000 - £95000 per annum + Benefits

2nd Line Engineer

Camden, London £32000 - £38000 per annum

1st Line Support Engineer

Camden, London £24000 - £30000 per annum