Data Engineer

The Data Platform team manages, supports, and enhances the system that powers Edmunds’ business intelligence. Our user base consists of analysts, engineers, business owners, sales, and executives. Analysts and engineers use the Data Platform to build production pipelines that ingest and curate Edmunds core data. Business users interact with AI tools, reports, dashboards, and other query engines to glean insights from said data. The Data Platform team is seeking a great engineer to help us grow, maintain and support this system that almost every Edmunds employee utilizes day to day.

What You’ll Do:

• Administer and support our Databricks platform and the underlying AWS infrastructure.
• Support and collaborate with various cross-functional customers such as:
  • Business & Executives
  • Engineering teams & Data Science
  • Analytics
  • Security & Infrastructure
• Explore, POC, and propose adoption of new features and technologies for the platform.
• Build and maintain ETL pipelines for operational data that help us understand the health of the many different facets of the Data Platform.
• Build, enhance, and maintain IaC artifacts for admin tooling (CDK, Terraform).
• Ensure teams can effectively use the Data Platform to build internal and external facing AI solutions.
• Build, enhance, and maintain dashboards, alerts, and reports that allow us to act on operational, cost, and security signals.

What You Need:

• 4+ years of experience in Data Engineering or similar role.
• Proficiency in Spark (Python or Scala).
• Fluency in Python and SQL.
• Extensive experience both using and administering Databricks.
• Familiarity with IaC concepts and hands on experience with Terraform and/or CDK.
• Excellent problem solving, troubleshooting, and communication skills in a hybrid environment.
• Bachelor's degree in Computer Science, Engineering, or equivalent experience.