AmeriLife Logo

AmeriLife

Senior Data Engineer - PySpark

Posted 3 Hours Ago
In-Office or Remote
Hiring Remotely in CA
Senior level
In-Office or Remote
Hiring Remotely in CA
Senior level
Design and develop scalable data pipelines using PySpark and Databricks, focusing on data ingestion, transformation, validation, and performance optimization.
The summary above was generated by AI

Our Company

Explore how you can contribute at AmeriLife.

For over 50 years, AmeriLife has been a leader in the development, marketing and distribution of annuity, life and health insurance solutions for those planning for and living in retirement.

Associates get satisfaction from knowing they provide agents, marketers and carrier partners the support needed to succeed in a rapidly evolving industry.

Job Summary

The Senior Data Engineer will design and develop scalable data pipelines that support analytics, reporting, and AI initiatives across the enterprise data platform.

Job Description

Key Responsibilities

  • Build and maintain PySpark pipelines in Databricks
  • Develop scalable data ingestion and transformation workflows
  • Implement data validation and quality checks
  • Optimize Spark workloads and processing performance
  • Work closely with architecture and analytics teams

Core Technical Skills

  • Strong expertise in Python and SQL
  • Experience with PySpark, Spark, and Databricks
  • Experience building ETL/ELT pipelines
  • Strong understanding of data transformation and performance optimization

Additional Expectations

  • Strong communication and teamwork skills
  • Ability to collaborate across engineering and analytics teams
  • Passion for building scalable data systems

Bonus Qualifications

  • Databricks certification
  • AWS or Azure certification

Compensation

  • Salary Range: $135,000 to $155,000
  • This role may be eligible for a discretionary annual bonus.
  • Salary offers will vary commensurate with experience, education, skills, and training 

What AmeriLife Offers

A comprehensive benefits package that includes PTO, medical, dental, vision, retirement savings, disability insurance, and life insurance.

Equal Employment Opportunity Statement

We are an Equal Opportunity Employer and value diversity at all levels of the organization. All employment decisions are made without regard to race, color, religion, creed, sex (including pregnancy, childbirth, breastfeeding, or related medical conditions), sexual orientation, gender identity or expression, age, national origin, ancestry, disability, genetic information, marital status, veteran or military status, or any other protected characteristic under applicable federal, state, or local law. We are committed to providing an inclusive, equitable, and respectful workplace where all employees can thrive.


Americans with Disabilities Act (ADA) Statement

We are committed to full compliance with the Americans with Disabilities Act (ADA) and all applicable state and local disability laws. Reasonable accommodations are available to qualified applicants and employees with disabilities throughout the application and employment process. Requests for accommodation will be handled confidentially. If you require assistance or accommodation during the application process, please contact us at [email protected].


Pay Transparency Statement

We are committed to pay transparency and equity, in accordance with applicable federal, state, and local laws. Compensation for this role will be determined based on skills, qualifications, experience, and market factors. Where required by law, the pay range for this position will be disclosed in the job posting or provided upon request. Additional compensation information, such as benefits, bonuses, and commissions, will be provided as required by law. We do not discriminate or retaliate against employees or applicants for inquiring about, discussing, or disclosing their pay or the pay of another employee or applicant, as protected under applicable law. Pay ranges are available upon request.


Background Screening Statement

Employment offers are contingent upon the successful completion of a background screening, which may include employment verification, education verification, criminal history check, and other job-related inquiries, as permitted by law. All screenings are conducted in accordance with applicable federal, state, and local laws, and information collected will be kept confidential. If any adverse decision is made based on the results, applicants will be notified and given an opportunity to respond.


Top Skills

Databricks
Pyspark
Python
Spark
SQL

Similar Jobs

13 Days Ago
Easy Apply
Remote or Hybrid
Easy Apply
Senior level
Senior level
Artificial Intelligence • Cloud • Computer Vision • Hardware • Internet of Things • Software
The Sales Director will manage an Enterprise Sales team, develop metrics, coach Account Executives, and foster inclusion within a high-performing team.
Top Skills: SFDC
18 Days Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Lead enterprise architecture and solution delivery for BOS, managing teams and driving complex OSS/BSS transformations. Focus on presales and enhancing offerings.
Top Skills: AgileAIAnalyticsApi EcosystemCloud-NativeCompliance ArchitectureContinuous DeliveryData ManagementDevOpsEtomGiap CertificationIntegrationOdaOpenaiPlatform ArchitecturePrincipal Solution ArchitectPrivacy ArchitectureSecurity ArchitectureSidTamTmforumTogaf
19 Days Ago
In-Office or Remote
Expert/Leader
Expert/Leader
Cloud • Information Technology • Internet of Things • Machine Learning • Software • Cybersecurity • Infrastructure as a Service (IaaS)
Lead the BOS Integrated Services Hub, focusing on pre-sales, service delivery, and team management in a high-pressure telecom environment.
Top Skills: Ai/MlApi ManagementBssCloud-NativeCobitData AnalyticsItilMicroservice ArchitectureOssSafe

What you need to know about the Toronto Tech Scene

Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account