Data Engineer (FedD024)

EMPLOYER IS A CONTRACTOR FOR THE U.

THIS POSITION WILL REQUIRE U.

CITIZENSHIP.

Responsabilidades

: Designing data workflows, pipelines, and pathways to support ETL/ELT, while ensuring data-quality and exchange of sensitive information across AWS cloud and on-prem environments

Implementing systems engineering principles to ensure the reliability, scalability, and maintainability of data layer systems, including backup and recovery strategies Architecting, deploying, and operating data streaming technologies (Kafka, Redpanda, Kinesis, etc ) on Kubernetes with an emphasis on declarative definitions to reduce complexity in day-2 operations Working with a platform team to implement best practices for configuration management, security, and performance optimization within Kubernetes and AWS environments Working with a platform team to automate infrastructure provisioning, monitoring, and scaling using tools such as Terraform working with cybersecurity SMEs to incorporate best practices and techniques to defend our data layer against potential threats Ensuring that our data layer systems are compliant with industry and DoD regulations, standards, and best-practices Staying up-to-date with industry trends and emerging technologies related to Kubernetes, containerization, and data engineering Travel Expectations/.

Requisitos

: 6-10 times per year The listed responsibilities are not exhaustive and additional responsibilities may be assigned based on the evolving needs of the organization

We are seeking a dynamic individual who is able to adapt and take on new responsibilities as they arise.

*Preferred Experience and.

Calificaciones

: Demonstrated experience (minimum 5 years) in building and maintaining production data pipelines, databases, and data exchange services on Kubernetes Experience in designing, deploying, and operating Kafka / Redpanda data streaming solutions on Kubernetes Experience in creating data pipelines from scratch with the ability to proces...