We are seeking a skilled Azure Data Engineer to join our team. The ideal candidate will have a strong background in Big Data projects on Azure and participate in the implementation of BIG Data platform solutions, tools and technologies

The Candidate is expected to have experience in developing and optimizing SQL/SPARKSQL queries. The work is closely with our data scientists and engineers to create efficient and scalable solutions for querying and managing BIG datasets.

Key Responsibilities

  • Develop and optimize SQL/SPARKSQL/ queries to retrieve and manipulate data
  • Develop and optimize PYSPARK code
  • Design and implement data models in Databricks with SQL/SPARKSQL
  • Collaborate with data scientists and engineers to integrate SQL/SPARKSQL queries into applications.
  • Perform data analysis and transformation using SQL/SPARKSQL.
  • Ensure the performance and scalability of SQL/SPARKSQL queries.
  • Maintain and update existing SQL/SPARKSQL queries and data models.
  • Troubleshoot and resolve issues related to Queries using SQL/SPARKSQL

Requirements

  • Python, Pyspark, SQL / SparkSQL
  • Experience working with relational databases (SQL Server, Oracle, MySQL, etc.), and HANA DB as Row Based DB
  • Expertise in Azure and its services such as Azure Databricks, Azure DataFactory, Azure Devops etc
  • Proven experience as a SQL/SPARKSQL Developer or similar role.
  • Experience with programming languages such as Python/PYSPARK
  • Proven experience with BIG DATA projects
  • Has a vast experience on Azure platform and tools
  • Experience with ORC and ROW BASED databases
  • Proficiency in query optimization and performance tuning.
  • Strong problem-solving skills and attention to detail.
  • Excellent communication and teamwork skills.
  • Knowledge of data integration and ETL processes.
  • Experience with data visualization tools and techniques

We offer

  • Remote work
  • Trust-based managerial culture
  • Team rituals and get-togethers
  • Referral bonuses for recommending your friends
  • Career development
  • Paid Time Off (Vacations, Sick & Public Holidays in your country)

If interested, please share your CV at iuliana@euroasiarecruiting.com.