Senior Data Engineer
Remote (United States)
Job Details
Location: United States
Workplace: Fully Remote; optional New York City office available
Employment Type: Full Time
Experience: 4+ years as a Data Engineer or Senior Data Engineer, or 5+ years as a Software Engineer working primarily with Python and SQL
Core Areas: Data Platform Engineering, Python, SQL, Apache Airflow, Apache Spark/PySpark, Snowflake, S3 Data Lake, Distributed Computing
Compensation: $160,000–$180,000 base salary per year, with anticipated total annual compensation of $176,000–$198,000
About the Role
This opportunity is for a Senior Data Engineer focused on developing and maintaining a high-scale data platform, infrastructure, and processing workflows that power internal and external business intelligence. The platform processes more than 7 TB of data every 90 minutes, supporting complex analytics for partners and actionable reporting for internal stakeholders.
The role combines hands-on data platform development with production software engineering practices across Python, SQL, Apache Airflow, Apache Spark/PySpark, Snowflake, S3, Kubernetes on EKS, and automated testing. The engineer will design new platform solutions, deliver production features, strengthen reporting capabilities, and balance platform improvements with practical delivery.
What You'll Do
- Design and plan new data platform solutions in collaboration with engineering leadership, engineering and product teams, and internal stakeholders using RFC and Tech Spec documents.
- Collaborate with engineering peers to implement high-quality production software and data platform solutions.
- Help plan and execute new software features while ensuring data platform requirements are incorporated into technical designs.
- Own execution from technical specification through production delivery using the established software development lifecycle.
- Share technical knowledge through code reviews, pair programming, one-on-one discussions, and broader team training.
- Develop deep expertise in the data ecosystem and reporting platform through hands-on code development supporting Client Strategy, Business Operations, and external partners.
- Balance technical debt, long-term maintainability, and practical delivery when designing and implementing solutions.
- Develop working knowledge of nonprofit giving and e-commerce enablement to better support relevant data and reporting requirements.
- Contribute to a supportive engineering culture centered on accountability, continuous improvement, knowledge sharing, and professional growth.
Qualifications
Required Experience
- 4+ years of experience as a Data Engineer or Senior Data Engineer using Python and SQL to develop data-intensive applications or insights, or 5+ years of Software Engineering experience using Python and SQL in a primarily Python codebase.
- Experience working with production-level data systems in a collaborative engineering environment.
- Experience using Apache Airflow for production task orchestration.
- Experience using a Business Intelligence tool such as Tableau.
Required Skills
- Strong proficiency in Python and SQL for production data development.
- Strong proficiency with relational databases, particularly PostgreSQL.
- Working knowledge of observability, performance optimization, continuous integration, automated testing, and cloud infrastructure.
- Understanding of distributed computing architecture and data warehouse and data lake storage patterns.
- Ability to explain and advocate for technical projects clearly to non-technical stakeholders.
Preferred Qualifications
- Experience working in an early-stage startup environment.
- Experience setting up and administering a Business Intelligence platform such as Tableau.
- Experience with Apache Spark.
- Experience managing a Kubernetes cluster.
- Bachelor's degree in Computer Science or a related technical or analytical field, or equivalent training, fellowship, or professional experience.
Benefits
- 50% employer match on 401(k) contributions of up to 6% of base salary.
- $100 monthly wellness stipend.
- $750 annual professional development budget.
- Fully remote work with no planned in-office requirement.
- Optional access to office space in New York City.
Looking for more opportunities?
View All Jobs