About the job RQ10941 - 2 x Sr. Software Developer
RQ10941 - 2 x Sr. Software Developer
2 openings - 2 different submissions
11-month contract - possible extension
ONSITE 5 days - 5700 Yonge St.
Security Level: CRJMC
Responsibilities:
1. Design, develop, test, implement, and troubleshoot:
o data pipelines using Python and AWS services (Glue, StepFunctions, Lambda)
o complex data transformation procedures
o data models for the efficient storing of data in relational databases as well as in unstructured data repositories
o re-useable classes and modules as to enhance the maintainability and ability to deliver solutions quickly.
2. Review existing code base and assist other more junior team members ensuring a consistent level of quality.
3. Assess new business requirements and propose adequate technical solutions (using on-prem and on-cloud resources)
MUST HAVES:
- Data engineering (pandas, pyspark)
- Working with XLSX, CSV, JSON files, relational databases, cloud storage, structured and unstructured data
- Experience using AWS Services such as Glue, StepFunctions, Lambda, S3
- Extract/Transform/Load data using tools such as Informatica IDMC
Nice-to-have:
· Data processing automation
· Linux experience
· Experience with cloud data warehousing and analytics (AWS Redshift or equivalent)
- Public sector experience