Senior Java Big Data Developer with 8+ years building applications on Cloudera/Hadoop ecosystems using Spark and MapReduce. Responsible for designing performant Java (1.8+) solutions, data analysis of large datasets, unit testing (JUnit), and collaborating with/managing global technology teams. Preferred skills include Unix/Python scripting and familiarity with Hive, Impala, YARN, and Kafka.
Qualifications
- Minimum 8+ years of relevant experience in applications development
- Expertise in Bigdata ecosystem (Cloudera Distribution) using spark and Map Reduce
- Java (core) 1.8 or above - Hands-on experience (advanced concepts of data structures, memory management and design patterns)
- Apache Spark - Hands on (preferable on Java spark)
- Bigdata ecosystem (Good understanding of Hadoop, preferable cloud era distribution), exposure to Hive, Impala, Yarn, Kafka
- Good Data analysis and programing skills and understanding of large datasets (no sql joins)
- Good knowledge of Java and spark architecture and design principles
- Good experience in Junit/Testing frameworks
- Unix/Python shell scripting experience is a big plus
- Experience managing global technology teams
- Working knowledge of industry practices and standards
- Good communication skills
Similar Jobs
Cloud • Computer Vision • Information Technology • Sales • Security • Cybersecurity
Lead and execute incident response engagements, perform host and network forensics across Windows, macOS, and Linux, conduct basic malware analysis and reverse engineering, develop hunting methods, produce reports and remediation plans, engage with legal and executives, and contribute thought leadership and public-facing content.
Top Skills:
AIAWSAzureBroGCPLinuxmacOSSuricataWindowsZeek
Artificial Intelligence • Fintech • Hardware • Information Technology • Sales • Software • Transportation
Lead Motive's strategy and execution to enter and scale Mexico, the UK, and Canada and evaluate further international expansion. Own go-to-market roadmaps, localization, demand generation, partnerships, and budget allocation. Build and manage a small regional team and agency partners, align cross-functional stakeholders, define success metrics and reporting, run test-and-learn experiments, and present commercial outcomes to executive leadership.
Blockchain • eCommerce • Fintech • Payments • Software • Financial Services • Cryptocurrency
The Software Engineer will enhance Lending products for Cash App, focusing on building complex systems, APIs, and collaborating with multiple teams to support economic empowerment through accessible credit.
Top Skills:
AuroraAWSDynamoDBGrpcGuiceHibernateHTTPJavaJettyJooqJSONJunitKafkaKotlinMySQLOkhttpProtocol BuffersRedisVitess
What you need to know about the Toronto Tech Scene
Although home to some of the biggest names in tech, including Google, Microsoft and Amazon, Toronto has established itself as one of the largest startup ecosystems in the world. And with over 2,000 startups — more than 30 percent of the country's total startups — Toronto continues to attract new businesses. Be it helping entrepreneurs manage their finances, simplifying business operations by automating payroll or assisting pharmaceutical companies in launching new drugs, the city's tech scene is just getting started.
