JOB SEEKERS
EMPLOYERS
JOBS QUICK-SEARCH
.net
.net developer
a+
abap
account manager
accountant
admin
administrator
analyst
architect
bookkeeper
business analyst
business intelligence
c#
call centre
ccna
cisco
cloud
cobol
consultant
delphi
desktop
desktop support
developer
engineer
finance
graduate
graduates
helpdesk
internship
it manager
it support
it technician
java
java developer
junior developer
legal
linux
manager
marketing
mcse
network
network administrator
oracle
personal assistant
php
php developer
programmer
project
project administrator
project manager
receptionist
sales
sap
secretary
security
sql
support
technical support
technician
test analyst
tester
web developer
NEWSLETTER
FOLLOW US
Data Engineer BIG DATA - Johannesburg North Up to R900k per annum
Job Ref
282099
Job Type
Permanent
Employer Type
Recruitment Agency
Date Added
23 Aug 2019
Expiry Date 20 Sep 2019
Expiry Date 20 Sep 2019
* There has been 1 application to this job.
* This job has been viewed 2837 times.
Employer:
E-Merge IT Recruitment
Location:
Gauteng
Salary:
Market related
Benefits:
Role details:
You will be building world-class, scalable data pipelines and warehouses to add real value to customers and drive new product development, both internally and externally.
- - - - - - - - - - - - - -
Requirements: Completed BSc (Computer Science) degree or similar (Software Engineering, Data Science etc. with experience in software)
2-5 years experience in Data Engineering (Hadoop and Spark)
Data Processing products - Big Query, Redshift, Spectrum, S3, Athena, Kafka, Spark, Storm, Flink, Beam, Presto, Hive
ETL processes and transformations
Cloud experience ideally with Google Cloud Platform
DevOps Stack development experience
Apache-Airflow or other data pipeline tools
Exposure to Scala or Java in context of data processing
Experience and proficiency with Python
Experience in the design and implementation of data flows
Advanced SQL/PostgreSQL/Redshift knowledge
Responsibilities:
Support sophisticated predictive data products by maintaining data science production environments (cloud-based, python), ensuring that the outputs from Data Science models are available and integrated into the system and integrate, coordinate and maintain data flows between various sources of data
Manage and maintain cloud service integrations that perform key data functions by working towards replacing third-party elements of the data pipeline by using open-source tools
Make decisions around the infrastructure, layout and processes of the data warehouse, including:
working with the engineering team on how to best track and record data
following up on data inconsistencies to ensure that it is corrected
Transforming, standardizing and collecting data from various sources
Reference Number for this position is LV46312 which is a permanent position based in Johannesburg North offering a salary of up to R900k per annum highly negotiable on experience and ability. Contact Liza on lizavdb@e-merge.co.za or call her on 011 463 3633 to discuss this and other opportunities.
Are you ready for a change of scenery? The e-Merge IT recruitment is a specialist niche recruitment agency. We offer our candidates options so that we can successfully place the right developers with the right companies in the right roles.
Check out the e-Merge website www.e-merge.co.za for more great positions
Do you have a friend who is a developer or technology specialist? We pay cash for successful referrals!