EngineerJobs.io
← Back to all jobs

Job Description

This role is for a Senior Cloud Data Engineer working onsite in Columbia, SC, supporting enterprise data lake initiatives through AWS-based, cloud-native big data solutions. The position includes technical leadership across architecture and strategy, with hands-on development and ongoing support for integrated applications and services.

Responsibilities

  • Design, code, test, implement, and support application software across the full systems life cycle, delivering work on time and within budget.
  • Review and analyze systems to streamline processes, maximize reusability, and reduce costs across subsystems.
  • Build prototypes and technical solutions that can serve as templates for more complex business requirements.
  • Research, diagnose, and resolve defects in existing code, and address maintenance issues across development, testing, and production.
  • Collaborate with customers, business analysts, and team members to define requirements and ensure solutions align with architectural standards.
  • Provide design recommendations, including component and data architecture, performance monitoring, product evaluation, and buy versus build decisions.
  • Develop programming standards and identify new data sources and approaches.
  • Lead and coordinate complex projects, and mentor junior engineers and analysts.

Required Qualifications

  • In-depth experience with big data technologies, including Spark.
  • Strong experience with AWS services, including Cognito, API Gateway, Amplify, RDS, Lambda, CloudFront, CloudWatch, DynamoDB, SES, EventBridge, WAF, KMS, Secrets Manager or Parameter Store, Certificate Manager, Route 53, and S3.
  • Experience with PostgreSQL, Python, and Node.js.
  • Strong communication skills, including experience guiding stakeholders and leading technical projects.

Technical Skills

  • AWS, Spark, Python, Node.js
  • Cognito, API Gateway, Amplify, RDS, Lambda, CloudFront, CloudWatch, DynamoDB
  • SES, EventBridge, WAF, KMS, Secrets Manager, Parameter Store
  • Certificate Manager, Route 53, S3, PostgreSQL

Nice to Have

  • AWS DataSync, Lake Formation, or Redshift
  • Scala, Vue.js, Hive, Kafka, Oozie, or Sqoop
  • Git and IntelliJ

Similar Jobs