Data Engineer (DBA)
The ideal candidate will have at least 3 years of experience in data engineering and will be responsible for building and maintaining our data infrastructure and pipelines. You will work closely with our data analysts in the team to ensure our data is accurate, reliable, and accessible.
KEY DUTIES & RESPONSIBILITIES:
Design and develop data pipelines and infrastructure that enable efficient and reliable processing, storage, and retrieval of data.
Develop and maintain data integration and ETL workflows to bring together data from multiple sources.
Ensure the security and compliance of our data infrastructure and pipelines.
Collaborate with data scientists and analysts to ensure data quality and accuracy.
Optimize data structures and algorithms to improve performance and reduce processing time.
Develop and maintain documentation of data infrastructure and pipelines.
Continuously monitor and troubleshoot data infrastructure to ensure reliability and availability.
Keep up-to-date with the latest industry trends and technologies in data engineering.
ESSENTIAL EXPERIENCE, SKILLS AND QUALIFICATIONS
Hard skills
Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
At least 3 years of experience in data engineering.
Strong experience with data processing frameworks such as Spark, Hadoop, or Flink.
Experience with ETL tools such as Azure Data Factory, Airflow, Luigi, or NiFi.
Strong proficiency in SQL and experience with database systems such as Microsoft SQL Server, MySQL, PostgreSQL, or MongoDB.
Strong experience with programming languages such as C#, Python, Java, or Scala.
Experience with multi-cloud computing, and cloud platforms such as AWS, Azure, or GCP.
Experience with DevOps CI/CD tools such as Jenkins, Git, GitLab.
Strong understanding of data warehousing and data modeling concepts and scripting.
Experience with data visualization tools such as Tableau or PowerBI is a plus.
Familiarity with NoSQL, ML and AI concepts
Soft skills
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
High degree of initiative, dependability and ability to work with little supervision
Inherently demonstrate a high level of integrity and be trustworthy
The ability to maintain confidentiality in regard to information processed, stored, or accessed by the systems
The ability to develop knowledge of, respect for, and skills to engage with those of other cultures or backgrounds
KEY DUTIES & RESPONSIBILITIES:
Design and develop data pipelines and infrastructure that enable efficient and reliable processing, storage, and retrieval of data.
Develop and maintain data integration and ETL workflows to bring together data from multiple sources.
Ensure the security and compliance of our data infrastructure and pipelines.
Collaborate with data scientists and analysts to ensure data quality and accuracy.
Optimize data structures and algorithms to improve performance and reduce processing time.
Develop and maintain documentation of data infrastructure and pipelines.
Continuously monitor and troubleshoot data infrastructure to ensure reliability and availability.
Keep up-to-date with the latest industry trends and technologies in data engineering.
ESSENTIAL EXPERIENCE, SKILLS AND QUALIFICATIONS
Hard skills
Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
At least 3 years of experience in data engineering.
Strong experience with data processing frameworks such as Spark, Hadoop, or Flink.
Experience with ETL tools such as Azure Data Factory, Airflow, Luigi, or NiFi.
Strong proficiency in SQL and experience with database systems such as Microsoft SQL Server, MySQL, PostgreSQL, or MongoDB.
Strong experience with programming languages such as C#, Python, Java, or Scala.
Experience with multi-cloud computing, and cloud platforms such as AWS, Azure, or GCP.
Experience with DevOps CI/CD tools such as Jenkins, Git, GitLab.
Strong understanding of data warehousing and data modeling concepts and scripting.
Experience with data visualization tools such as Tableau or PowerBI is a plus.
Familiarity with NoSQL, ML and AI concepts
Soft skills
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
High degree of initiative, dependability and ability to work with little supervision
Inherently demonstrate a high level of integrity and be trustworthy
The ability to maintain confidentiality in regard to information processed, stored, or accessed by the systems
The ability to develop knowledge of, respect for, and skills to engage with those of other cultures or backgrounds