Featured job
Data Engineer - IT
Job Details
Job Description
We are seeking a Data Engineer with deep expertise in ETL/ELT, PySpark, Databricks, Azure ecosystem, and experience with Enterprise Systems like Oracle ERP, ERP Fusion, and Salesforce. The successful candidate will play a key role in designing and implementing complex data pipelines, handling both structured and unstructured datasets, and optimizing our Azure-based data systems. The successful candidate will have a strong foundation in data warehousing concepts and database design. Additionally, this individual will work closely with other data engineers & the data science team to support their analytics needs and improve the performance of our data products.
Key Responsibilities:
Design, construct, install, test, and maintain highly scalable and robust data management systems.
Understand and apply data warehousing concepts to design and implement robust data warehouse tables in line with business requirements.
Build complex ETL/ELT processes for large-scale data migration and transformation across platforms and Enterprise systems such as: Oracle ERP, ERP Fusion, and Salesforce.
Ability & expertise to extract data from several sources like APIs, Jsons, Databases etc
Leverage PySpark and Databricks within the Azure ecosystem to manipulate large datasets, improve the performance, and enhance scalability of our data operations.
Develop and implement Azure-based data architectures consistent across multiple projects while adhering to best practices and standards.
Lead initiatives for data integrity and normalization within Azure data storage and processing environments.
Evaluate and optimize Azure-based database systems for performance efficiency, reusability, reliability, and scalability.
Troubleshoot complex data-related issues within Azure and provide expert guidance and support to the team.
Ensure all data processes adhere to governance, data security, and privacy regulations.
Required Qualifications:
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer.
Expertise in Python, SQL, and deep understanding of PySpark.
Proficient in Databricks or similar big data solutions.
Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.
Proven experience in designing and deploying high-performance data processing systems on.
Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks.
Ability to design and implement data schemas, data models, and database designs in accordance with business requirements.
Preferred Qualifications:
Databricks certification or equivalent big data technology certification.
Exceptional analytical and problem-solving abilities.
Excellent communication skills.
Required Qualifications:
Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field.
8+ years of experience in a Data Engineer role, with at least 3 years as an Azure data engineer.
Expertise in Python, SQL, and deep understanding of PySpark.
Proficient in Databricks or similar big data solutions.
Strong knowledge of ETL/ELT frameworks, data structures, and software architecture.
Proven experience in designing and deploying high-performance data processing systems on.
Extensive experience with Azure cloud data platforms, including Azure Data Factory, Azure SQL Data Warehouse, Azure Databricks.
Ability to design and implement data schemas, data models, and database designs in accordance with business requirements.
Preferred Qualifications:
Databricks certification or equivalent big data technology certification.
Exceptional analytical and problem-solving abilities.
Excellent communication skills.
Register on https://app.ziphire.hr/dev-register
Kindly do so in order to take your application further