The Data Engineer at Butter Payments will architect data systems, ensure high-quality data ingestion and transformation, and collaborate with ML teams to optimize workflows.
About Butter Payments:
At Butter Payments, we’re on a mission to eliminate involuntary churn and make recurring payments seamless. Every year, billions of dollars are lost due to failed payments. Butter leverages machine learning, deep financial data partnerships, and behavioral insights to ensure the right payments go through at the right time—without friction. We're backed by world-class investors like Atomic, Norwest Venture Partners, SpringTride, Transpose Platform, and we're growing fast.
The Problem Statement:
You will work closely with Software Engineering, Machine Learning Engineers and Data Analysts. You help ingest, organize and enable Butter to continue to deliver value on the data we collect. We make sure it arrives in a timely manner, is organized and usable, and is of a high quality. Key to all the work Butter does.
Problem Expanded:
We ingest 3rd-party data from multiple payment providers, such as Stripe, clean it and normalize it for our schema and machine learning pipelines.
We're seeking to build transformation and validation layers as far upstream as possible to ensure a smooth flow of data through our system. The transformation layer will make the data easier to work with for our reporting products and ML models, while the validation layer will ensure the data conforms to our expectations. For example: Is it null, NULL, or 'null'? Is 342 a valid country abbreviation code?
As we expand our product offering and ingest data from additional companies and 3rd-party providers the complexity of the challenge will evolve over time, keeping the problem fresh.
Scope:
You'll get to architect our system and lay the foundation for the future from both a technology and a system design perspective.
No longer will data show up without being tested and structured, as you'll create a system that checks its worst tendencies. You'll work closely with our ML and Eng team to ensure the design meets their requirements and that data properly flows through the system.
Philosophies:
- You strongly believe that action creates information.
- You want to work on a small team and have lots of responsibility.
- You look forward to being scrappy and enjoy overcoming challenges.
Requirements:
- 5+ years of experience delivering value through data at an early stage, high growth startup (ideally within the payments industry)
- Prior experience with cloud environments such as AWS or GCP
- Strong Data Modeling experience, and familiarity with different approaches (Intermediate and up)
- Strong SQL skills
- Strong Python skills
- Prior experience with workflow orchestration tools (Prefectm, Airflow, Dagster)
- Experience with distributed systems workflows (Temporal, AWS Step functions)
- Experience with cloud OLAP providers and optimization (Snowflake, Redshift, BigQuery)
- Experience with Kafka pub/sub patterns and data ingestion
- Experience with data transformation patterns and common tools (dbt)
We are focused on building a diverse and inclusive workforce. If you’re excited about this role, but do not meet 100% of the qualifications listed above, we encourage you to apply.
--------
Butter Payments is an Equal Opportunity Employer and considers applicants for employment without regard to race, color, religion, sex, orientation, national origin, age, disability, genetics or any other basis forbidden under federal, state, or local law. Butter considers all qualified applicants in accordance with the San Francisco Fair Chance Ordinance.
Please review our CCPA policies here.
Top Skills
Airflow
AWS
BigQuery
Dagster
Dbt
GCP
Kafka
Prefect
Python
Redshift
Snowflake
SQL
Temporal
Similar Jobs
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Principal Platform Architect guides customers in their digital transformation journey through the ServiceNow platform, ensuring alignment between technology solutions and business objectives while providing governance and technical expertise.
Top Skills:
AICloud Application TechnologyServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
Architects guide customers through digital transformation by providing architectural guidance, optimizing platform strategies, and ensuring successful project delivery with a focus on ServiceNow solutions.
Top Skills:
AICloud Application TechnologyServicenow
Artificial Intelligence • Cloud • HR Tech • Information Technology • Productivity • Software • Automation
The Principal Platform Architect is responsible for advising clients on establishing a technical foundation in the ServiceNow platform and driving effective digital transformation. This role includes managing technical governance, developing customer roadmaps, and guiding teams in delivering technical solutions.
Top Skills:
AICloud ApplicationsServicenow Platform
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
