Data Engineer

Location: Horsham, West Sussex Salary: £500 - £550 per day
Sector: IT & Telecoms Specialism:
Type: Contract Contact: Sam Francis

Data Engineer

Duration / End Date: 31/03/2021

Clearance: SC

Location: Portsmouth 2-3 days/week, Horsham 2-3 days a week

Start Date: ASAP

Rate: £500-£550/day

Job Description: Working within the clients Data platform team to develop new features, prepare deployment packages, and support the Data Platform through its lifecycle

Responsibilities include:

  • Extending the existing client platform to support the ingest, storage, and egress of new data sets.
  • Supporting deployments of the platform
  • Identifying and improving current services

Required Skills: Core skills:

  • Familiarity with Agile methodologies
  • Working in a small, flat hierarchical team
  • Atlassian suite (JIRA, Confluence, Bitbucket)
  • Git (version control)

Essential Experience:

  • Building data ingest pipelines (NiFi, Bash script writing, Python, Scala)
  • Understanding of how the Hadoop ecosystem works
  • Connecting multiple CoTS and open source technologies together to produce a wider solution (Nifi, Kafka, Scala, GraphQL, HBase)
  • Containerising applications using Docker (Docker), the ability to write Dockerfiles and docker-compose.yml, and debugging Docker containers
  • Defining and developing APIs (Language agnostic)

Desirable Expereince:

  • Continuous integration/development processes. (inc. Apache Airflow)
  • Ingesting, storing and exposing image and/or video data.
  • Understanding of networking
  • Understanding of DeveOps Tools (Jenkins and Ansible)
  • Ability to use the Linux terminal (SCP, tmux, grep etc.)
  • Understanding of Spark
  • Using an IDE (IntelliJ, PyCharm)

Services advertised by Gold Group are those of an Agency and/or an Employment Business.
We will contact you within the next 14 days if you are selected for interview. Privacy Policy. Equal Opportunity and Diversity Policy.

Similar Jobs

CPE Engineer

Amsterdam, North Holland €380 - €400 per day

Network Engineer

Crawley, West Sussex Benefits

Network Engineer

Amsterdam, North Holland €48 - €50 per hour

2nd Line Desktop Engineer

Cobham, Surrey £24000 - £28000 per annum + + Benefits

IT Field Engineer

Shoreham-By-Sea, West Sussex £26000 - £34000 per annum