Senior Software Engineer
Job Description
The Senior Software Engineer will lead development and integration of scalable, secure, and efficient data architectures and solutions to support national security missions. This is an onsite role in Washington, DC, and requires an active TS/SCI clearance with Polygraph (Poly) clearance.
Responsibilities
- Design, develop, and maintain robust data pipelines and architectures using AWS, Azure Data Lake, Hadoop, Spark, and other cloud-based platforms for large-scale processing and analysis.
- Implement ETL workflows using tools such as Talend and Informatica, along with custom Python or Shell scripts, to extract, transform, and load data from diverse sources into data warehouses such as Oracle or Microsoft SQL Server.
- Develop and optimize SQL queries and database schemas to support high-performance storage and analytics; design data models aligned with project requirements.
- Create analytical dashboards and reports using Looker to help stakeholders visualize insights from complex datasets.
- Collaborate in Agile teams to develop RESTful APIs for secure, seamless data integration across systems while ensuring compliance for sensitive information.
- Support machine learning initiatives through model training and analysis, leveraging PyTorch or TensorFlow as needed.
- Analyze big data sets using Apache Hive, Spark, and related tools to uncover actionable insights, troubleshoot issues, and improve system performance.
- Write Bash (Unix shell) scripts and VBA macros to automate routine tasks, and contribute to database design efforts for scalable data warehouses.
- Improve team outputs through code reviews, documentation updates, and process enhancements aligned with Agile practices.
Requirements
- Active TS/SCI clearance with Polygraph (Poly) required.
- Extensive experience with AWS and Azure Data Lake, including familiarity with cloud security best practices.
- Strong proficiency in Java, Python, SQL (including Microsoft SQL Server and Oracle), Shell Scripting, Bash (Unix shell), VBA, and ETL tools such as Talend or Informatica.
- Proven expertise with big data technologies including Hadoop, Spark, Apache Hive, and Looker for analytics visualization.
- Hands-on experience designing data warehouses and implementing database schemas optimized for performance and scalability.
- Knowledge of RESTful API development for integrations and understanding of model training techniques for machine learning applications.
- Ability to analyze large datasets and interpret complex data patterns effectively.
- Experience working in Agile environments and strong collaboration skills across multidisciplinary teams.
Technologies
- AWS
- Azure Data Lake
- Hadoop
- Spark
- Talend
- Informatica
- Python
- Shell Scripting
- Bash (Unix shell)
- SQL
- Oracle
- Microsoft SQL Server
- Looker
- RESTful APIs
- PyTorch
- TensorFlow
- Apache Hive
- VBA
- ETL
Compensation and Work Location
- Pay: $92,681.15 - $200,000.00 per year
- Work Location: In person, Washington, DC
- Location: Washington, DC (onsite)