About the job Principal Data Engineer
Key Responsibilities of Principal Data Engineer:
Guide the team towards successful project delivery
Provide technical leadership and key decision making
Work with and mentor individual team members to meet professional goals
Continuous effort to automate and increase team efficiency
Maintain high standards of software quality via code review, testing, automation standardization, and tooling
Collaborate directly with both developers and business stakeholders
Provide estimates and risk-reducing spike stories
Assist in collection and documentation of requirements from business
Assist in planning deployments and migrations
Prepare status updates and run the daily standup
Analyze data problems and provide solutions
Assess opportunities for improvements and optimization
Required Qualifications of the Principal Data Engineer:
Masters Degree or equivalent work experience
Minimum 12 years of experience working with open source databases
Minimum 10 years of experience working with ETL and related data pipeline technologies.
Highly proficient in open source SQL systems, particularly MySQL and PostgreSQL
Proficiency in multiple scripting languages, including Python and Ruby
Demonstrable experience with cloud-based ETL tools, including EMR,
Expertise with distributed data stores, with demonstrable experience using Redshift and with optimizing query performance
Deep understanding of data structures and schema design
Prior work with AWS ecosystem, particularly RDS, SQS and SNS, StepFunctions, CDK)
Exceptional analytical, organizational, interpersonal, and communication (both oral and written) skills
Self-motivated, driven, resourceful, and able to get things done
Enjoy working in fast-paced, collaborative, Agile environments
Ability to adapt and learn quickly is a fundamental necessity
Benefits:
401(k)
Dental Insurance
Health insurance
Health savings account
Paid time off
Professional development assistance
Vision insurance