Overview
Overview Iron EagleX (IEX), a wholly owned subsidiary of General Dynamics Information Technology, delivers agile IT and Intelligence solutions. Combining small-team flexibility with global scale, IEX leverages emerging technologies to provide innovative, user-focused solutions that empower organizations and end users to operate smarter, faster, and more securely in dynamic environments Responsibilities Job Description: We are seeking a Data Ecosystem Data Engineer SME – Hybrid to design, build, and maintain data collection, processing, and integration pipelines that centralize and structure data from various web-based applications. You will work closely with software developers, data analysts, and product teams to ensure seamless data flow, high-quality data storage, and efficient retrieval methods. This role is ideal for someone passionate about data-driven decision-making and optimizing data aggregation processes while exploring and identifying right-sized technologies and computing resources. This is not a Data Science, Big Data, ML-Ops, or AI-related role. Instead, this position focuses on wrangling disparate data sources into unified, consumable data APIs for internal and external stakeholders. This is a Hybrid position in Crystal City, VA (3 days onsite, 2 remote). Job Duties Include (but not limited to): Design, develop, and maintain data ingestion pipelines to collect structured and unstructured data from user applications and bulk data sources.
Implement efficient data transformation and storage strategies to facilitate easy retrieval and analysis.
Collaborate with software development teams to optimize application-generated data for streamlined aggregation.
Ensure data integrity, security, and compliance with industry regulations and company policies.
Optimize query performance and improve data access patterns to support analytical and operational use cases.
Work with business stakeholders to define data requirements and improve data accessibility for decision-making.
Design and build APIs to support data ingestion, retrieval, and integration with external systems.
Develop and maintain event-driven architectures, utilizing event storage for real-time data processing. Qualifications Required Skills & Experience: 10+ years of experience in data engineering, software development, or a related role.
Proficiency in database technologies, including SQL, NoSQL, and event-based databases (e.g., PostgreSQL, MySQL, MongoDB, EventStoreDB).
Strong programming skills in Golang, Python, and JavaScript/TypeScript.
Experience with cloud-based data solutions (AWS, GCP, or Azure) and data warehousing.
Experience working with AWS S3 for scalable storage solutions and OpenSearch for search functionality.
Proficiency in developing and managing APIs using FastAPI.
Experience using Trino for query optimization and distributed SQL processing.
Proficiency in working with Parquet Files for efficient data storage and retrieval.
Hands-on experience with Airflow for orchestrating complex data workflows.
Familiarity with Databricks Medallion model.
Familiarity with OpenMetaData for metadata management and data governance.
Experience working with streaming and batch data processing frameworks is a plus.
Due to US Government Contract Requirements, only US Citizens are eligible for this role. Security Clearance: An active TS/SCI security clearance is REQUIRED Benefits: National Health, vision and dental plans 20 days of PTO and 11 paid holidays Life Insurance Short – and long-term disability plans 401(K) retirement plans Incentive and recognition programs Relocation opportunities Equal Opportunity Employer / Individuals with Disabilities / Protected Veterans