Technology & IT
$75,700 - $136,300 USD yearly
As a Software Engineer, you will design and develop data pipelines using Python and Airflow. You will optimize data flows and process datasets using Spark, Flink, and enterprise databases. Additionally, you will automate workflows and debug systems using shell scripting in Unix environments.
As a Software Engineer, you will be responsible for:
- Designing, building, and maintaining ETL/ELT pipelines using Python, Airflow, and internal data frameworks
- Processing and transforming large datasets to enable high-quality analytics and reporting
- Developing and optimizing data models to support business-critical applications and dashboards
- Writing efficient, scalable, and reusable code while following software engineering best practices
- Utilizing Unix or Linux environments for data automation, scripting, and system debugging
- Collaborating with cross-functional teams to ensure data accuracy and availability
Do what you love
To be successful in this role you will:
- Have a Bachelor's degree in Computer Science
- Possess solid proficiency in Python programming and scripting
- Have understanding of SQL, data modeling, and relational database systems
- Be familiar with ETL/ELT concepts and workflow orchestration systems
- Demonstrate experience working in Unix or Linux environments with shell scripting
- Be knowledgeable about distributed data frameworks like Spark, Flink, or Airflow
United States
Full-time
$75,700 - $136,300 USD yearly
1 hour ago