Senior Data Analyst (Big Data)
| Location | Johannesburg, South Africa |
| Date Posted | June 5, 2020 |
| Category |
Data Entry
IT / Information Technology |
| Job Type |
Full-time
|
| Currency | ZAR |
Description
Contract position to join financial service provider in JHB. Seeking skilled Data Analysis with completed Post Graduate IT Degree and minimum 8 years’ experience in big data, relational SQL, NoSQL databases, performing root cause analysis, AWS cloud services and experience overseeing junior data engineering activities.
Must have clear criminal and clear credit report.
Duties & Responsibilities
- Responsible for overseeing junior data engineering activities and aiding in building the organisations data collection systems and processing pipelines.
- Oversee infrastructure, tools and frameworks used to support the delivery of end-to-end solutions to business problems through high performing data infrastructure.
- Responsible for expanding and optimising the organisations data and data pipeline architecture, whilst optimising data flow and collection to ultimately support data initiatives.
Desired Experience & Qualification
- Post Graduate IT Degree
- Experience overseeing junior data engineering activities
- 8 years’ experience with big data tools: Hadoop, Spark, Kafka, etc.
- 8 years’ experience building processes supporting data transformation, data structures, metadata, dependency and workload management.
- 8 years’ experience manipulating, processing and extracting value from large disconnected datasets.
- Working knowledge of message queuing, stream processing, and highly scalable ‘big data’ data stores.
- 8 years’ experience with relational SQL and NoSQL databases, including Postgres and Cassandra.
- 8 years’ experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc. 8 years’ experience with AWS cloud services: EC2, EMR, RDS, Redshift.
- 8 years’ experience with stream-processing systems: Storm, Spark-Streaming, etc.
- 8 years’ experience with object-oriented/object function scripting languages.
- Strong analytic skills related to working with unstructured datasets.
- Experience developing ETL processes.