ML, AI, Data Platform

Principal Engineer - Machine Learning Architecture

All jobs

As a Principal Engineer, Machine Learning Architecture within our Data+ML organization, you will lead the technical vision and development of ML infrastructure used to support the end-to-end development and delivery of ML models at Marqeta. You will collaborate closely with Machine Learning Science, Product, and Engineering teams to refine ML development journeys, define our target state ML architecture, drive technical design decisions that inform its implementation, and collaborate with our engineering teams to deliver it. In this role, you will work closely with our engineering teams to drive the adoption of best practices across the organization and improve our operating posture. You will build effective working relationships outside the Data+ML organization, including product and engineering leaders, coach and mentor members of the Data+ML team, and participate in the design and build out of Marqeta's data and ML ecosystem.  

This role will report directly to the Sr. Director of Machine Learning and will lead the design and development of Marqeta’s Machine Learning infrastructure.

We work Flexible First. This role can be performed remote within the United States or from our Oakland, CA headquarters. We’d love for you to join us!

The Impact You'll Have

  • Build a technical vision for our ML infrastructure optimized to support our customers and internal Machine Learning Scientists in alignment with our business and AI strategy 
  • Create infrastructure to support end-to-end ML development and delivery including prototyping, data and feature pipeline development, model training, deployment, and monitoring on AWS
  • Collaborate with Machine Learning Science, Product, and Engineering teams to define technical designs, integrations with our core products, and deliver highly available ML capabilities to our end-users
  • Maintain a high bar for operational excellence, drive best practices, and operate ML capabilities within established SLAs
  • Collaborate with key Product, Engineering and Security stakeholders to drive governance, security and management best practices including standards, processes and tools to improve our operating posture
  • Provide career mentorship and guidance to members of the Data+ML organization on topics including engineering skills, best practices, and business communication

Who You Are

  • 10+ years experience in a Machine Learning engineering or architecture role with deep expertise in ML architecture, MLOps, feature stores, data pipelines, inference and monitoring infrastructure using AWS managed services
  • 10+ years expertise building large scale, compliant ML architectures in the financial services or similarly regulated industry 
  • 10+ years experience using product-oriented, user experience-centered approaches to building ML platforms and services 
  • Excellent communication and interpersonal skills, with the ability to cultivate relationships across teams, influence decision making, and collaborate with stakeholders at all levels of the organization
  • Proven ability to develop structure, advance execution, and measure performance within various and complex projects, teams, and environment
  • Excellent verbal and written communication skills including the ability to create technical design and product requirements documentation 
  • Proactive and strategic mindset, with the ability to anticipate business needs of customers and stakeholders
  • A strong bias toward action and ability to operate proactively and effectively in a dynamic, fast-paced environment
  • High ethical standards and a commitment to promoting a strong culture
  • BS degree preferred

Compensation And Benefits

  • Flexible time off – take what you need
  • Retirement savings program with company contribution
  • Equity in a publicly-traded company and an Employee Stock Purchase Program
  • Health insurance premiums paid 100% + coverage for dependents and pets
  • Family-forming benefits including fertility support and up to 20 weeks of Parental Leave
  • Free therapy sessions, financial coaching, and legal advice
  • Monthly stipend to support our hybrid work model

Our Applicant and Candidate Privacy Notice applies to the personal data that you directly provide to us or that we collect during the application and candidate recruitment process.

Compensation and Benefits

Marqeta is a Flex First company which allows you to choose your best working environment, whether that be from home or at a company office. To support Flex First, we calibrate pay to a competitive value according to working location. Compensation is aligned according to three tiers within the United States:

  • National: A baseline tier that applies to most of the geographic territory of the United States.
  • Premium: Slightly elevated from the National tier, and oriented toward a narrower set of higher cost-of-living areas, such as Los Angeles CA and Seattle WA
  • Premium Plus: A tier for the most expensive working areas, like the San Francisco Bay area and New York City.

Visit this page or consult with a Recruiter to determine which tier would be applicable to you.

When determining salaries, we consider several factors including, but not limited to, skills, prior experience, and work location. The new-hire base salary range for this position is:

  • National: $231,700 - $289,600
  • Premium: $250,700 - $313,400
  • Premium Plus: $272,600 - $340,700

We also believe in recognizing the contributions of our people. That's why we award annual bonuses to eligible employees, rewarding both individual performance and the success of the entire company.

Along with monetary compensation, Marqeta offers

  • Multiple health insurance options
  • Flexible time off – take what you need
  • Retirement savings program with company contribution and after tax contributions
  • Equity in a publicly-traded company and an Employee Stock Purchase Program
  • Family-forming benefits, fertility support, and up to 20 weeks of Parental Leave
  • Free therapy sessions, financial and professional coaching, and legal advice
  • Monthly stipend to support our remote work model
  • Annual “development dollars” to support our people growth and development

About Marqeta

Marqeta is on a mission to change the way money moves. We’re one of the earliest enablers of embedded finance, a market opportunity sized up in the trillions. Our card issuing platform provides unprecedented flexibility and control for companies to issue cards, authorize transactions, and manage payment operations in real time. Marqeta is powering the most well known brands in the new economy (Block, Cash App, Affirm, Instacart, Doordash, Uber, Walmart, etc). You don’t need to be a Payments expert to join the Marqeta Team, let us help you with that.  This is the opportunity of a lifetime to work with innovators around the world and unlock equitable financial access for all.


Marqeta’s Values

– Solve for the Customer: With a deep understanding of our customers' business and empathy for their needs, we deliver products and services that drive their success. Earning and keeping their trust guides everything we do.

– Do What's Right: Knowing businesses and livelihoods depend on us, we pursue solutions that disrupt responsibly and deliver high-quality results that our customers count on. We own our work from start to finish.

– Simplify and Innovate: We approach challenges with curiosity and take smart risks. Innovation comes from finding better, simpler ways to achieve extraordinary outcomes.

– Win as a Team: We succeed together by embracing diverse perspectives and pushing each other to raise the bar. We lead with humility and set aside hierarchy to work as a team.

– Make it Count: We drive forward with focus and agility. With a sense of urgency and purpose, we get the job done, and done right.


Equal Employment Opportunity, Accommodations and Privacy 

Marqeta is proud to be an equal opportunity employer that gives consideration to all qualified applicants regardless of race, ancestry, national  origin, color, Indigenous, citizenship, religion/creed, sex, sexual orientation, gender identity, gender expression marital status, family status, disability, veteran status, criminal histories consistent with legal requirements, or any other characteristic protected by applicable law. 

Our dedication to diversity and inclusion extends beyond the categories above. Review Marqeta’s ESG Report to see that dedication in action. Fostering an environment where everyone feels valued and respected creates a stronger and more innovative team at Marqeta. We celebrate the unique contributions of each individual and empower all members of our organization. Join us in building a company where diversity thrives and everyone can be their authentic selves.

If you require reasonable accommodation for the application process and beyond (including due to a disability), please submit this form and we will be more than happy to assist you. Marqeta will make reasonable accommodations for candidates when needed in accordance with applicable law. The Applicant and Candidate Privacy Notice applies to the personal data that you directly provide to us or that we collect during the application and candidate recruitment process.