AWS Cloud Data Engineer
| Location | Cape Town, South Africa |
| Date Posted | July 14, 2022 |
| Category |
Engineering
|
| Job Type |
Full-time
|
| Currency | ZAR |
Description
Are you passionate about data engineering and the challenges of building complex data systems? Engineered systems that need to run big corporations and younger start-ups alike. IQbusiness is looking for Cloud Data Engineers to build data solutions, ranging from data warehousing to big data platforms. Your primary responsibilities will be to implement solutions in coordination with the rest of the team working on different layers of the solution's architecture. Therefore, a commitment to collaborative problem solving, sophisticated design, and a quality product are essential.
We strongly believe in and follow Agile software development and DevOps best practices and principles. IQbusiness fosters a solid culture of learning, mentoring and knowledge sharing. The successful candidates will build high-quality, innovative and fully performing data solutions in compliance with best practices, standards, current technology stack and technical design.
Basic Qualifications
- Relevant Bachelors' Degree / Diploma / recognised qualification from an accredited tertiary institution
- At least 2 years of Consulting or client service delivery experience on Amazon AWS (AWS)
- At least 3- 5 years of experience in developing data ingestion, data processing, data engineering and analytical pipelines for big data, relational databases, NoSQL and data warehouse solutions
Duties & Responsibilities
- Experience with public cloud architectures, pros/cons, and migration considerations
- Hands-on experience in AWS and Big Data technologies such as AWS EC2, AWS S3, AWS Lambda, Spark/SparkSQL, and streaming technologies such as Apache Kafka, AWS Kinesis, Apache NiFI etc.
- 3+ years of hands-on experience in programming languages such as Java, C#, Node.js, Python, PySpark, SQL, Unix shell/Perl scripting etc.
- Experience working with DevOps tools such as GitHub, GitLab, Jenkins, CodeBuild, CodePipeline, CodeDeploy, etc.
Ideally have one or more of the following AWS certifications
- Certified AWS Developer - Associate
- Certified AWS DevOps - Professional
- Certified AWS Data Analytics Specialty
Methodologies and Frameworks
- Data Integration (ETL and ELT)
- Enterprise Data Warehousing and Enterprise Data Lake
- Data Management
- Data Visualisation and Presentation
Soft Skills
- Great communication skills
- Strong knowledge of the financial services industry, ideally in a consulting role
- Ability to work in different project methodologies: Waterfall and/or Agile
Job Specification
You will represent IQbusiness to our clients, sometimes alone and sometimes as part of an IQ team. If you're doing your job well, the customer will be comfortable and confident with both you as an individual and the work you produce.
As all IQbusiness roles require honesty in the handling of or access to cash, finances, financial systems, or confidential information; our recruitment process requires that the following background checks be completed: credit, criminal, ID, and qualification verification.
IQbusiness is committed to sustainable growth and transformation, we embrace diversity and employ previously disadvantaged individuals