About Us
At dss+, we don’t seem to be simply your moderate international operations consulting company. We’re a Objective-driven corporate that exists to avoid wasting lives and create a sustainable long term – for our purchasers, staff and communities. In pursuit of this Objective, we put folks on the centre of the whole thing we do, and we’re a consultancy with center.
The Position
We’re looking for an skilled Information Engineer with experience in Azure Databricks to design, construct, and care for tough knowledge pipelines and architectures. This function is significant in enabling our groups to derive actionable insights from complicated knowledge units, supporting strategic decision-making and industry transformation.
Key Obligations
-
Information Structure and Pipeline Building:
-
Design and put into effect scalable, environment friendly knowledge pipelines and workflows the use of Azure Databricks and related Azure gear.
-
Optimize knowledge ingestion, transformation, and garage for various knowledge sorts (structured, semi-structured, and unstructured).
-
-
Cloud Information Answers:
-
Construct and set up cloud-based knowledge environments, making sure prime availability, safety, and function.
-
Combine quite a lot of knowledge assets into unified platforms to beef up analytics and gadget studying packages.
-
-
Collaboration with Information Groups:
-
Spouse with knowledge scientists, analysts, and stakeholders to verify knowledge answers align with industry objectives.
-
Facilitate easy handoffs between engineering and knowledge science groups for complicated analytics workflows.
-
-
Efficiency Optimization:
-
Observe, troubleshoot, and optimize knowledge pipelines for velocity, reliability, and scalability.
-
Follow perfect practices for code optimization, knowledge partitioning, and value potency in cloud environments.
-
-
Information Governance and High quality:
-
Put into effect knowledge governance frameworks, making sure compliance with safety, privateness, and trade rules.
-
Increase and care for knowledge high quality tracking gear and processes.
-
What You Deliver
-
Obligatory Experience in Azure Databricks:
Confirmed enjoy in designing, imposing, and optimizing answers at the Azure Databricks platform. -
Programming Abilities:
Complicated wisdom of SQL, Python, PySpark or Scala for knowledge engineering duties. -
Giant Information Frameworks:
Enjoy with Apache Spark, Delta Lake, and identical applied sciences. -
Drawback-Fixing Skill:
Demonstrated talent in debugging and resolving efficiency bottlenecks in knowledge programs. -
Collaboration and Communique:
Skill to paintings successfully with cross-functional groups and be in contact technical ideas to non-technical stakeholders. -
Agile Practices:
Enjoy running in agile environments with iterative supply and steady growth methodologies.
Most well-liked {Qualifications}
-
Familiarity with CI/CD pipelines for knowledge workflows.
-
Working out of knowledge modeling and schema design ideas.
-
Enjoy with gear like Databricks Workflows, MLflow, or Azure DevOps.
Let’s have a look at the place our shared imaginative and prescient leads.
We’ve got a robust expansion trajectory and a world footprint, this means that remarkable alternative for the folks on our groups to advance their occupation.
As a World Corporate, our pros have the likelihood to give a contribution to develop with the corporate. Each worker can affect and affect our corporate, and we price innovators and marketers.
Past that, be your self. At dss+, we embody and have fun range. Above all, we’re an inclusive tradition during which everybody contributes and has the risk to broaden their skills additional.