We are seeking a highly experienced and innovative Principal Data Engineer to lead the design, development, and optimization of our data infrastructure and pipelines. As a key technical leader, you will work cross-functionally to develop scalable solutions, mentor team members, and drive best practices in data engineering to enable data-driven decision-making across the organization.
This is what you'll do:
Data Architecture & Strategy
- Design, build, and maintain scalable, robust data architectures to support business objectives.
- Define and drive the long-term data strategy in collaboration with Product Management, Technology Team Leadership, and other key stakeholders.
- Ensure high availability and security of data systems while optimizing for performance and cost efficiency.
Pipeline Development & Optimization
- Develop and maintain complex ETL/ELT pipelines for structured.
- Optimize data flows and integration across a wide variety of data sources (e.g., APIs, databases, and cloud platforms).
- Implement data quality frameworks and ensure accuracy, consistency, and timeliness of data.
Leadership & Mentorship
- Act as a technical mentor and coach for data engineering team members.
- Lead code reviews, establish development standards, and foster a culture of technical excellence.
- Collaborate with cross-functional teams to translate business needs into technical requirements.
Innovation & Continuous Improvement
- Stay abreast of emerging technologies and industry trends, integrating them into the company’s data ecosystem.
- Evaluate and recommend tools, platforms, and solutions to improve scalability and efficiency.
- Identify bottlenecks and implement enhancements to improve system performance.
This is what you'll need:
- Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.
- 8+ years of experience in data engineering, including designing and managing large-scale data architectures.
- Strong understanding of data modeling, data warehousing, business intelligence, and data lakes as well as data governance, data lineage, and data security.
- Deep knowledge of SQL and database systems, including Microsoft SQL Server and Snowflake.
- Experience with Kafka and SSIS for streaming and ETL/ELT.
- Expertise in programming languages such as C#, Powershell and/or Python.
- Experience with AWS cloud platform.
- Proficiency with CI/CD pipelines and version control (Github).
- Strong analytical, problem-solving, and communication skills.
- Proven ability to lead and mentor engineering teams.
- Experience with machine learning pipelines or real-time data processing. (preferred)
- Experience with Postgres (preferred)
- Knowledge of presentation layer tooling such as Sisense and/or AWS QuickSight including administration and reporting/dashboarding. (preferred)