• Login Name       Password       Remember me       LOGIN LOGIN    FORGOT PASSWORD
  • REGISTER

 LOGIN WITH
 
 
 
 
 EMPLOYERS
 
 
 
 
 
 NEWSLETTER
 
 
 
 
 FOLLOW US

Data Engineer

Job Ref
284873
Job Type
Permanent
Employer Type
Recruitment Agency
Date Added 12 Aug 2022
Expiry Date 26 Aug 2022
* There have been 2 applications to this job.
* This job has been viewed 4586 times.
Employer:
Luxfiat

Location:
Gauteng

Salary:
Market related

Benefits:


Role details:
One of our clients has an exciting opportunity for a Data Engineer. Data engineers work in a variety of settings to build systems that collect, manage, and convert raw data into usable information for data scientists and business analysts to interpret.
The ultimate goal is to make data accessible so that organizations can use it to evaluate and optimize their performance.
- - - - - - - - - - - - - -
Key Responsibilities/Accountabilities

• Analyse and organize raw data
• Build data systems and pipelines
• Evaluate business needs and objectives
• Interpret trends and patterns
• Conduct complex data analysis and report on results
• Prepare data for prescriptive and predictive modelling
• Build algorithms and prototypes
• Combine raw information from different sources
• Explore ways to enhance data quality and reliability
• Identify opportunities for data acquisition
• Develop analytical tools and programs
• Collaborate with data scientists and architects on several projects

Preferred Qualification and Experience

Qualifications:

• Must have completed Matric (Grade 12)
• Relevant Degree in Computer Science, IT, or similar field.

Skills/ Knowledge and Experience:

• Minimum of 4+ proven work experience with data models, data mining, and segmentation techniques
• Relevant programming languages (e.g. Java, Scala, Python) experiences.
• Hands-on experience with SQL database design
• Relevant Apache Spark experience as well as good Apache Hadoop, Hue, Impala understanding
• Good understanding of sharding and partitioning strategies.
• Excellent understanding and relevant experience with NoSql databases – HBase (advantageous)
• Understanding and experience with structured (such as RDBMS, spreadsheets), semi-structured (such as log files, XML, JSON) and unstructured (such as text, video, audio, images, vibration) data sources
• Good conceptual understanding of machine learning as well as different algorithms and libraries
• Good understanding of ML features and feature store
• Experience with Nifi, Airflow or similar product
• ETL tools

Behavioral Attributes:

• Coding
• Data warehousing
• Knowledge of operating systems
• Database analysis
• Critical thinking skills
• Basic understanding of machine learning
• Communication skills


APPLY  
 



 
HOME|
INFO|