Cloudera data engineer

For a project with Škoda Auto, we are looking for a Data Engineer specialised in the Cloudera platform, a key component of our big data database that allows us to gain deeper insights and take our analytical capabilities to the next level. Your role will not only be to gain insight into the Cloudera platform, but also to monitor traffic, look for sub-optimalities, and give it overall direction. If this fits well with your ideas, let us know!

‍

What does this position entail?

• Active monitoring of production jobs on the Cloudera platform;
• Analyzing problems and proposing solutions;
• Optimizing operations and resources for all BI environments (Cloudera, PowerBI, etc.);
• Implementation of methodological rules and best practices for all BI environments;
• Supporting development teams (including self-service BI development outside of IT);
• Collaboration with the Application Management Support team;
• Collaborating on the development of the integration framework and adding new patterns (sharing knowledge of best practices for autonomous teams);
• Development of tools for data management solutions (DAP Data Viewer, DAP KPI dashboard, operational metadata).

What do we need you to know and be able to do?

• Knowledge of Cloudera components (Impala, Hive, HDFS, SPARK) at a developer level;
• Azure DevOps or similar versioning system;
• Apache Airflow (knowledge of tool management);
• Knowledge of some EL/ETL tool;
• Organizational and communication skills - collaboration with other teams (Cloudera operations, PBI operations, database team, development team, etc.) is required.