Senior Data Engineer

Thoughtworks

  • Ho Chi Minh City
  • Permanent
  • Full-time
  • 1 day ago
Senior data engineers at Thoughtworks are engineers who build, maintain and test the software architecture and infrastructure for managing data applications. They are involved in developing core capabilities which include technical and functional data platforms. They are the anchor for functional streams of work and are accountable for timely delivery. They work on the latest big data tools, frameworks and offerings (data mesh, etc.), while also being involved in enabling credible and collaborative problem solving to execute on a strategy.*At the time of application, candidates must be Vietnam citizens.Job responsibilities
  • You will develop and operate modern data architecture approaches to meet key business objectives and provide end-to-end data solutions.
  • You will develop intricate data processing pipelines, addressing clients' most challenging problems.
  • You will collaborate with data scientists to design scalable implementations of their models.
  • You will write clean, iterative code using TDD and leverage various continuous delivery practices to deploy, support and operate data pipelines.
  • You will use different distributed storage and computing technologies from the plethora of options available.
  • You will develop data models by selecting from a variety of modeling techniques and implementing the chosen data model using the appropriate technology stack.
  • You will collaborate with the team on the areas of data governance, data security and data privacy.
  • You will incorporate data quality into your day-to-day work.
Job qualificationsTechnical Skills
  • At least 5 years professional experience in data engineering or related fields.
  • Proficient with Databricks (SparkSQL, PySpark, Spark DataFrames) and open table format design & optimisations (Delta Lake, Apache Iceberg)
  • Proficient with dbt (core/cloud) and advanced SQL for analytical transformations, streaming and batch data ingestion frameworks on cloud platforms (AWS/ Azure/ GCP).
  • Proficient with Python engineering skills with software engineering best practices.
  • Experience with using DevOps platforms (GitLab/GitHub CI/CD, Terraform) and containerisation.
  • Proficient with data quality, testing, and governance (Great Expectations, dbt tests, data contracts).
  • Working knowledge of modern data architecture patterns (Medallion, data mesh, data product approach).
  • Proficient with using orchestration/workflow tools.
  • Experience with observability & monitoring (logging, alerting, pipeline performance tracking).
Professional Skills
  • You thrive in a collaborative, flat environment that values transparency, openness, feedback and change.
  • You have a passion for learning and sharing knowledge as well as a desire to create meaningful solutions for business problems.
  • You are resilient in ambiguous situations and can approach challenges from multiple perspectives.
Nice to have
  • Attained a Cloud Data Engineer certification (GCP, AWS, or Azure) or a Databricks certification (Data Engineer Associate).
  • Experience leading and mentoring junior data engineers in large data teams, collaborating with business, analysts, and data scientists.
  • Experience in delivery of data governance frameworks including security and compliance in cloud data environments.
  • Working knowledge of multi-cloud architectures and cross-cloud data integration and experience in at least one warehouse (BigQuery, Redshift, Synapse).
Other things to knowLearning & DevelopmentThere is no one-size-fits-all career path at Thoughtworks: however you want to develop your career is entirely up to you. But we also balance autonomy with the strength of our cultivation culture. This means your career is supported by interactive tools, numerous development programs and teammates who want to help you grow. We see value in helping each other be our best and that extends to empowering our employees in their career journeys.About ThoughtworksThoughtworks is a dynamic and inclusive community of bright and supportive colleagues who are revolutionizing tech. As a leading technology consultancy, we're pushing boundaries through our purposeful and impactful work. For 30+ years, we've delivered extraordinary impact together with our clients by helping them solve complex business problems with technology as the differentiator. Bring your brilliant expertise and commitment for continuous learning to Thoughtworks. Together, let's be extraordinary.#LI-Onsite

Thoughtworks