Senior Software Engineer- Big Data

Job Description


Our Client is looking for a driven, dynamic individual with a proven track record of developing Big Data solutions. The ideal candidate will have a solid experience developing modern data solutions in Amazon Web Services and have a solid understanding of traditional data warehousing paradigms.

In this role, you will a part of the Payments Business Intelligence team and play a significant role in advancing our Client’s analytics capabilities. The Payments Business Intelligence team is responsible for building and maintaining the data warehouse, as well as, delivering analytic insights, reports, and self-service tools to global stakeholders.


  • Gather, document, and analyze business requirements; produce development estimates
  • Design, develop, test and deploy data collection, flow and transformation components
  • Troubleshoot and support existing data workflow processes; deliver fixes and optimizations where appropriate
  • Drives consensus on design/delivery
  • Participates in identifying/solving problems at the program and group level
  • Partner with BI users, software engineers and operations specialists on data related investigations, research and issue management
  • Helps prioritize work for the team in the absence of a manager


  • Passion for improving business outcomes through Big Data and Analytics
  • Experience building data solutions with Amazon Web Services, such as S3, EMR, Redshift and RDS
  • Experience building AWS infrastructure preferred
  • Expertise with Big Data Technologies (Hadoop, Hive, Spark, etc.)
  • Outstanding SQL scripting and ETL skills
  • Strong understanding of traditional Data Warehousing principles and architecture
  • Experience with scripting languages like Bash, PowerShell, or Python
  • *nix and/or Windows in an enterprise environment
  • Experience with report applications like Tableau, QlikSense, and QlikView a plus
  • Experience working in an Agile/SCRUM model
  • Excellent written and oral communication skills
  • Background in e-commerce or payment technologies is strongly preferred
  • Ability to work with a variety of stakeholders and effectively handle multiple tasks/deadlines with success
  • Bachelor’s degree in a technology or a related discipline is preferred

Reference Number: 5296