Senior Cloud Data Engineer
Backend Developer
Senior
Aws Cloud
Aws Data Engineer
Big Data
Cloud
Cloud Data Engineer
Cloud Data Engineering
Data Analysis
Data Analytics
Data Architecture
Data Engineer
Data Engineering
Data Integration
Data Pipeline
Data Platform
Data Processing
Data Warehouse
Database
Databases
Information Technology (IT)
Software Development
SQL
Job Description
This role is for a Senior Cloud Data Engineer working onsite in Columbia, SC, supporting enterprise data lake initiatives through AWS-based, cloud-native big data solutions. The position includes technical leadership across architecture and strategy, with hands-on development and ongoing support for integrated applications and services.
Responsibilities
- Design, code, test, implement, and support application software across the full systems life cycle, delivering work on time and within budget.
- Review and analyze systems to streamline processes, maximize reusability, and reduce costs across subsystems.
- Build prototypes and technical solutions that can serve as templates for more complex business requirements.
- Research, diagnose, and resolve defects in existing code, and address maintenance issues across development, testing, and production.
- Collaborate with customers, business analysts, and team members to define requirements and ensure solutions align with architectural standards.
- Provide design recommendations, including component and data architecture, performance monitoring, product evaluation, and buy versus build decisions.
- Develop programming standards and identify new data sources and approaches.
- Lead and coordinate complex projects, and mentor junior engineers and analysts.
Required Qualifications
- In-depth experience with big data technologies, including Spark.
- Strong experience with AWS services, including Cognito, API Gateway, Amplify, RDS, Lambda, CloudFront, CloudWatch, DynamoDB, SES, EventBridge, WAF, KMS, Secrets Manager or Parameter Store, Certificate Manager, Route 53, and S3.
- Experience with PostgreSQL, Python, and Node.js.
- Strong communication skills, including experience guiding stakeholders and leading technical projects.
Technical Skills
- AWS, Spark, Python, Node.js
- Cognito, API Gateway, Amplify, RDS, Lambda, CloudFront, CloudWatch, DynamoDB
- SES, EventBridge, WAF, KMS, Secrets Manager, Parameter Store
- Certificate Manager, Route 53, S3, PostgreSQL
Nice to Have
- AWS DataSync, Lake Formation, or Redshift
- Scala, Vue.js, Hive, Kafka, Oozie, or Sqoop
- Git and IntelliJ