The Position
ATC is looking for a Data Engineer to join our Engineering Unit. You will work together with experienced developers to add value to ATC ’s line of products and services. You will follow all steps of deployment, from design and implementation to testing and deployment.
Key Responsibilities
- Assemble large, complex data sets that meet functional and non-functional business requirements.
- Build the infrastructure required for optimal extraction, transformation, and loading (ETL/ELT) of data from a wide variety of data sources.
- Design and implement big data processing jobs using Apache Spark.
- Run data cleaning, providing normalized and structured data for reporting and AI usage.
- Develop and maintain scalable data infrastructures with high availability, performance, and capability to integrate new technologies.
- Work with stakeholders to assist with data-related technical issues and support their data infrastructure needs.
Qualifications
- Bachelor’s degree in Computer Science, Engineering, Mathematics, Physics, Data Science, or related fields; a Master’s degree is considered a plus.
- 2+ years of experience in a data-focused role such as Data Engineer, Analytics Engineer, Data Analyst, or Data Scientist.
- Strong SQL skills with the ability to navigate and analyze complex data models.
- Working experience developing data pipelines using Python and Apache Spark (PySpark / Spark SQL).
- Experience working with data warehousing concepts and designing analytical data models.
- Excellent spoken and written communication skills in English.
- Agile and Scrum methodologies.
Nice to Have
- Visualization Tools: Experience with BI tools such as PowerBI or Tableau for creating dashboard insights.
- Data Analytics Cloud Platforms:
- Experience with Databricks is considered a strong asset.
- Other cloud experience such as Microsoft Fabric is considered a plus.
