Job Openings Senior Big Data Engineer

About the job Senior Big Data Engineer

illumin is a leading technology company that provides marketers with a one-stop solution for omnichannel digital advertising with best-of-category return on advertising spend. Our journey automation technology, illumin, offers planning, buying and real-time intelligence from one platform. With proprietary Artificial Intelligence, illumin brings unique programmatic capabilities to close the gap between advertising planning and execution. illumin is headquartered in Toronto with offices throughout Canada, the U.S., Europe, and Latin America. For more information, visit illumin.com  and check out our Life @ illumin video here!

Position Overview:

illumin develops a next-generation SaaS platform that has innovated the way brands, and marketers connect with their audiences. Our engineers build technologies that process information at a massive scale to generate industry-leading analytics and serve millions of requests in real-time.

As a Senior Data Engineer (Spark/Scala), you will be responsible for designing and developing large-scale data processing solutions using Apache Spark and other big data technologies. The ideal candidate should have experience with Scala programming and a deep understanding of Spark architecture and internals. You will foster innovation and work with cutting-edge technologies.

Our ideal techie is eager to bring fresh ideas and write clean uniform software. This is a position that allows you to play a key role in our teams efforts to cultivate innovation and pat yourself on the back for a job well done.

What You Will Do:

  • Design, develop, and maintain large-scale data processing solutions using Apache Spark and Scala.
  • Develop ETL pipelines to process, clean, and transform data from various sources.
  • Optimize Spark jobs for performance and scalability
  • Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and deliver high-quality solutions.
  • Ensure data accuracy, consistency, and completeness throughout the entire data pipeline.
  • Develop and maintain APIs to facilitate data access and integration.

What You Will Need:

  • Bachelor's degree in Computer Science, Software Engineering, or related field.
  • 5+ years of experience in Scala programming and Spark development.
  • Strong understanding of Spark architecture and internals
  • Experience with distributed computing technologies (e.g., Hadoop, Hive, Kafka)
  • Experience with database technologies and SQL
  • Experience with developing and consuming APIs
  • Strong problem-solving skills and attention to detail
  • Excellent communication and collaboration skills
  • Solid understanding of data monitoring, alerting, and logging systems

What You Will Get:

  • An inspiring and family-focused culture with offices around the world.
  • A competitive compensation package.
  • Comprehensive health and dental benefits including life and disability insurance.
  • An unlimited vacation policy.
  • Generous parental leave benefits with a top-up plan.
  • Time with our executive coach and Chief Empowerment Officer to assist in your growth and professional development.
  • Participation in our Employee Recognition Awards program.
  • An annual education and learning stipend.
  • Corporate rates and perks including fitness membership discounts.
  • Embrace and promote our company values: Ignite, Flow, Soar, Grow

GREAT PLACE TO WORK®

illumin is certified as a Great Place to Work® after a thorough and independent analysis conducted by @Great Place to Work Canada. This certification is based on direct feedback from employees, provided as part of an extensive and anonymous survey about the workplace experience. Check out our website here.

DISCLAIMER


This description has been designed to indicate the general nature and level of work performed by the employee within this position. However, the actual responsibilities, duties, qualifications, and experience may vary. The Employee may perform other related duties as required to meet the ongoing needs of the organization. Information contained in this job posting/description is subject to change.

GREAT PLACE TO WORK®


illumin is certified as a Great Place to Work® after a thorough and independent analysis conducted by @Great Place to Work Canada. This certification is based on direct feedback from employees, provided as part of an extensive and anonymous survey about the workplace experience. Check out our website here.

DISCLAIMER


This description has been designed to indicate the general nature and level of work performed by the employee within this position. However, the actual responsibilities, duties, qualifications, and experience may vary. The Employee may perform other related duties as required to meet the ongoing needs of the organization. Information contained in this job posting/description is subject to change.

DIVERSITY, INCLUSION & EQUAL EMPLOYMENT OPPORTUNITIES


illumin is committed to the principle of equal employment opportunity for all our people and to providing a work environment free of discrimination and harassment. We expect and require the cooperation of all our people in maintaining an environment with mutual respect by and for all our employees and applicants.

All employment decisions at illumin are based on business needs, job requirements and individual qualifications, without regard to race, colour, ancestry, creed (religion), place of origin, ethnic origin, citizenship, sex (including pregnancy, gender identity), sexual orientation, age, marital status, family status, political belief, physical or mental disability, receipt of public assistance, or irrelevant record of the offence.

illumin provides accommodations for individuals with disabilities. If you require accommodation, please contact us by e-mail at TalentAcquisition@illumin.com. This ensures that the appropriate accommodations are in place during the recruitment and selection process and before you begin your journey with us.

Let us know what we can do to help you be successful during your recruitment experience at illumin.