Data Engineer (TS/SCI w/CI Poly Cleared)

Data Engineer (TS/SCI w/CI Poly Cleared), Elkridge, MD

• Full-time
• On-Site in Elkridge, MD
• Clearance Requirements:  Active TS/SCI w/CI Poly

Description

We are seeking a skilled Database Engineer with hands-on experience supporting the Advana Defense Analytics Platform. This individual will play a critical role in the design, optimization, and maintenance of data pipelines and databases that support mission-critical analytics for the Department of Defense (DoD). The engineer will work alongside data analysts, engineers, and platform specialists to ensure seamless ingestion, transformation, and delivery of high-quality, secure data across the enterprise.

As a Data Engineer/Integrator, your role entails collaborating closely with a team of developers to fulfill data integration requirements. This involves writing and maintaining code using an Extract-Transform-Load (ETL) platform to ensure data is transformed into suitable formats as defined by IC ITE initiatives. You will interface with external teams and systems, employing various protocols including HTML and SFTP to collect data efficiently. Additionally, your responsibilities include enhancing the ETL platform by adding features aimed at shortening timelines for future data integration efforts. Beyond coding tasks, you'll develop and maintain software, ensuring seamless integration into a fully functional system. Collaboration with external teams will be necessary to validate data ingest processes. Finally, you'll be responsible for providing comprehensive documentation covering system architecture, development, and any enhancements made throughout the process.

Responsibilities

• Design, build, and optimize databases and data models to support Advana data pipelines.
• Develop and maintain robust ETL processes using Databricks, SQL, and other integrated tools in the Advana environment.
• Collaborate with data owners and mission stakeholders to ingest data from various DoD systems (e.g., financial, logistics, personnel).
• Implement data quality checks, validations, and metadata tagging to ensure high data integrity and traceability.
• Maintain and tune database performance, storage, and access across cloud and hybrid environments.
• Ensure compliance with DoD data governance, security, and audit requirements.
• Participate in agile development sprints and DevSecOps workflows.

Requirements

• 5+ years of professional experience with a Bachelor's degree or equivalent; 3+ years of professional experience with a Master's degree or equivalent; 10+ years of professional experience; Additional experience will be considered in lieu of a degree
• Active TS/SCI with with CI Polygraph
• Specialization using the Databricks platform for building, deploying, and managing data and AI solutions
• Experience building ETL pipelines, managing data pipelines, and working with large datasets using tools like Spark, Python, and SQL
• Experience with technologies like Delta Lake, Delta Live Tables, and Databricks Workflows
• Experience collaborating with data scientists
• Familiarity with Advana
• Strong Python programming skills
• Solid SQL knowledge for querying and data manipulation
• Cloud platform experience, such as AWS, Azure, etc.

Please Note:

• Only those individuals selected for an interview will be contacted.
• No calls, inquiries, or Third-Party Vendors please.
• We are an equal opportunity employer. We encourage applications from candidates of all backgrounds and experiences. (The ACI Group is unable to sponsor H1B Visas).
• $1000 Referral Bonus - www.aci.com.

Since 1988, The ACI Group, a Baltimore-based staffing firm, has been committed to hiring the industry's leading professionals, and presenting exciting career opportunities. We have access to varied types of contract, permanent and contract-to-perm positions and offer a choice of employment options including a full benefits package.