Jobbeschreibung
Otto Krahn Corporate Functions GmbH & Co. KG is part of the globally active Otto Krahn Group and is the Group's internal service provider. With our Finance, IT, Marketing and HR divisions, we support our businesses on their successful and sustainable growth path. The Otto Krahn Group is represented in over 30 countries with the plastics distributor ALBIS, the plastics compounder MOCOM, the KRAHN Chemie Group, KRAHN Ceramics GmbH and New Business.
In the IT and digitalization division, we create the technical basis for the smooth handling of business processes for the entire Otto Krahn Group. We support our departments in digitalization and automation as well as the further development of their processes and promote the use of innovative technologies. With around 60 team members, we support 1,800 users and 4,500 devices at 39 locations worldwide.
In Hamburg, we are looking for you as
Data Engineer (m/f/d)
Your mission
We are seeking a highly skilled and motivated Data Engineer (m/f/d) to join our dynamic team. As a Data Engineer (m/f/d), you will play a crucial role in designing, building, and maintaining our data infrastructure. You will be responsible for setting up robust data pipelines, modeling databases, and managing ETL (Extract, Transform, Load) processes to ensure the seamless flow of data across the organization. Your expertise will help us leverage data to drive informed decision-making and business growth.
Main tasks
- Design and Develop Data Pipelines: Build and maintain efficient and scalable data pipelines to collect, process, and store data from various sources, ensuring data quality, integrity, and availability.
- Database Modeling: Design and implement database schemas and structures that optimize data storage, retrieval, and processing for various business needs.
- ETL Processes: Develop, manage, and optimize ETL processes to extract, transform, and load data from different sources into target systems, ensuring timely and accurate data delivery.
- Cloud Data Solutions: Utilize Snowflake and Azure Data Factory to manage cloud-based data warehousing and data integration tasks, ensuring efficient data storage and accessibility.
- IoT Data Integration: Integrate data from IoT devices using Azure IoT Hub, ensuring real-time data processing and analytics.
Other tasks
- Workflow Orchestration: Implement and manage data workflows using Apache Airflow to automate and schedule ETL processes and other data-related tasks.
- Performance Optimization: Monitor and optimize data systems for performance, scalability, and cost efficiency.
- Data Security: Ensure that data systems comply with security standards and best practices, protecting sensitive data from unauthorized access and breaches.
- Collaboration: Work closely with data analysts and other stakeholders to understand data requirements and deliver solutions that meet business needs.
Experience and know-how
- Bachelor's degree in computer science, information technology, engineering, or a related field.
- Several years of experience as a Data Engineer (m/f/d) or in a similar role.
- Strong experience with data pipeline tools and techniques.
- Proficiency in Snowflake and Azure Data Factory.
- Knowledge of IoT data integration using Azure IoT Hub.
- Hands-on experience with Apache Airflow for workflow automation.
- Proficiency in ETL processes and tools.
- Strong SQL skills and experience with relational databases.
- Familiarity with data modeling principles and best practices.
- Experience with data visualization tools, especially Microsoft Power BI.
- Knowledge of cloud computing concepts, particularly in Azure.
- Experience with other cloud platforms such as AWS or Google Cloud.
- Familiarity with big data technologies such as Hadoop, Spark, or Kafka.
- Experience with Python or other scripting languages.
- Knowledge of data governance and data quality frameworks.
- Very good knowledge of German and English required
Personality
- Strong problem-solving skills and attention to detail.
- Excellent communication and collaboration skills.
Personal development
We stand for diversity and equal opportunities. That's why we also offer individual training that is perfectly tailored to personal learning needs.
Flexible working hours
Thanks to flexible working hours and home office arrangements (depending on the job), professional and private life can be optimally combined.
Health promotion
A wide range of health and sports activities, such as on-site and digital exercise classes, lectures, workshops, international athletic challenges, and much more, ensure fitness and well-being.
Foreign language program
After the probationary period, everyone has the opportunity to learn foreign languages conveniently and according to their individual needs via e-learning.
Motivating environment
Our pleasant working atmosphere is characterized by friendly interaction, a collegial atmosphere, and good cooperation within the teams.