Data Engineer

Trading Technologies is hiring a Data Engineer to join its Data & Analytics engineering team. This role focuses on modernizing a large SQL Server-based data platform to Snowflake and AWS, while building and maintaining reliable data pipelines, migrated workflows, and performance-tuned processing.

Responsibilities

• Develop, maintain, and optimize complex SQL Server queries, stored procedures, functions, and views, along with SQL-driven data processing workflows.
• Design and build scalable Snowflake data solutions, including data models, SQL transformations, loading processes, and analytical workloads.
• Support migration of large volumes of data and processing from SQL Server to Snowflake.
• Review existing SQL Server logic and translate or redesign it for Snowflake where appropriate.
• Build and maintain ETL/ELT pipelines using SQL, Python, and workflow orchestration tools such as Apache Airflow.
• Implement data ingestion and processing workflows using AWS, including S3.
• Perform performance tuning across both SQL Server and Snowflake, including query optimization, execution plan analysis, indexing, statistics, warehouse sizing, and workload optimization.
• Create data validation and reconciliation processes to ensure migrated and transformed data is accurate and complete.
• Troubleshoot production data issues, determine root causes, and implement long-term corrective solutions.
• Implement monitoring, logging, alerting, and operational controls for critical data pipelines.
• Collaborate with software engineers, service managers and implementation teams, product teams, and DevOps.
• Support and enhance existing Transaction Cost Analysis (TCA) products and develop new functionality.
• Work with large-scale trade, market, benchmark, and financial data.

Requirements

• Bachelor’s degree in Computer Science, Data Engineering, or a related field.
• Hands-on experience with Snowflake and AWS Cloud services, particularly S3 and data services.
• Strong hands-on SQL development experience.
• Python & C# scripting experience.
• Strong experience with Microsoft SQL Server, including complex query development, stored procedures, performance tuning, and troubleshooting.
• Experience working with large datasets and production data systems.
• Strong analytical and problem-solving skills.
• Experience migrating SQL Server workloads to Snowflake or another cloud data platform.
• Experience with Apache Airflow or similar orchestration technologies.
• Experience with Git, CI/CD, Liquibase, and automated deployment processes.
• Experience with data quality, reconciliation, and data governance.
• Knowledge of capital markets, trading, market data, or financial systems.
• Experience with Transaction Cost Analysis (TCA) or other financial analytics.
• Snowflake or AWS certification.
• Ability to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability.

Technologies

SQL, Python, C#, Microsoft SQL Server, Snowflake, ETL/ELT, Apache Airflow, AWS, S3, Git, CI/CD, Liquibase, SQL transformations, Data pipelines, Stored procedures, Functions, Views, Query optimization, Execution plans, Indexing, Statistics, Warehouse sizing, Workload optimization, Transaction Cost Analysis (TCA), Claude Code.

Location and Compensation

• Location: New York, NY (hybrid)
• Compensation: USD 94,500 - 115,000 per year

Benefits

• Medical, Dental, and Vision insurance
• Flexible Spending Accounts (FSA) & Health Savings Accounts (HSA)
• 401(k) retirement plan
• Pre-tax transit and parking benefits
• Hybrid position requiring three days of in-office collaboration per week, with flexibility to work remotely for the remaining two days
• 22 days of Paid Time Off (PTO) per year, with option to roll over unused days
• One dedicated day per year for volunteering
• Two professional development days per year for uninterrupted professional development
• Additional PTO day added during milestone anniversary years
• Robust paid holiday schedule with early dismissal
• Generous parental leave for all parents (including adoptive parents)
• Budget for tech accessories, including monitors, headphones, keyboards, and other office equipment
• Backup child and pet care, as well as tutoring services
• Milestone anniversary bonuses
• Stipend and subsidy contributions toward personally-owned cell phones
• Contributions for gym memberships and health/wellness initiatives
• Discounted healthcare premiums
• Healthy meal delivery program subsidies

AI-Assisted Development

• Engineers are encouraged to use modern AI-assisted development tools, such as Claude Code, to accelerate development, debugging, testing, refactoring, and migration work.
• Candidates should understand how to use AI effectively while independently validating generated code for correctness, security, performance, and maintainability.