Senior Data Engineer
Global Fashion Group View all jobs
- Ho Chi Minh City
- Permanent
- Full-time
- Both AWS and GCP
- BigQuery, SQL Server and Redshift
- Docker & Kubernetes
- Airflow, Cloud Composer and Pentaho
- Cloud Dataflow/Apache Beam
- High velocity streaming data, behavioural data and well as structured and unstructured data
- Develop and support our enterprise data warehouses, analytical databases and infrastructure
- Work with the team to re-platform our existing data architecture to next generation tooling and data architecture
- Build/Maintain our data pipelines in Python and SQL to ensure that data is delivered in a timely manner
- Work closely with our Data Scientists and Data Analysts to implement new insights and statistical models
- Assist in developing tools/processes to enable our business to self serve
- Extensive programming knowledge of Data processing within Python
- DataFrames
- Pandas
- Dependency management within Python
- Iterators, producers and consumer knowledge
- Airflow DAG building
- CI/CD - Bamboo Deployment / Delivery Experience
- Strong SQL coding skills
- Advanced Data Engineering Design Skills
- Excellent communication skills
- Significant experience in a similar Data Engineering role
- Strong data warehousing/Data Engineering experience
- Experience with data modelling and complex ETL solutions
- Test and QA Experience in Data Pipelines
- GCP experience
- BigQuery/Redshift
- Cube/SSAS Experience
- DevOps/CICD
- Docker
- Airflow
- R
9cv9