Software Data Engineer

Job Description 

Our software team is growing, and we are looking for a data engineer to be entrusted with designing, building, and optimizing large-scale data pipelines in both on-premise and cloud environments. Your role will encompass the management and storage of binary and tabular data, integration and collaboration with our AI/ML teams and stable large scale ETL pipelines. We value agility, so staying updated and adaptable to our evolving tech stack is inherent to the role. 

*This role is fully onsite*

Responsibilities 

• A solid experience with SQL and other databases 

• Collaborating with the data team and stakeholders 

• Manage and set up visualization tools 

• Monitoring and logging frameworks such as Grafana, Prometheus, Kibana and Elastic 

• Manage and design ETL processes, data cleansing, transformation, and integration 

• Work closely with our ML/AI teams 

• Proficiency in tools like Jenkins and Airflow 

 Requirements  

• Bachelor's/Master's degree in Computer Science, Engineering or a related field 

• 5+ years of proven experience as a Data Engineer or similar role in a startup or fast-paced environment 

• Strong proficiency in Python 

• Expertise in SQL and familiarity with other database systems 

• Hands-on experience with data visualization tools 

• Proficiency with monitoring and logging tools 

• Experience with data flow and CI/CD frameworks 

• Understanding of object storage solutions and best practices for binary data 

• Excellent problem-solving skills, analytical mindset, and attention to detail 

• Strong communication and collaboration skills