Sr.Data Engineer

【 What You'll be Doing 】

• Develop, operate, and monitor ETL and real-time data pipelines for data collection, cleansing, processing, storage, and analytics

• Design and maintain data schemas, and perform database performance tuning

• Develop backend APIs and maintain data visualization platforms for merchants

【 Who We are Looking for 】

• Fluent in Python and SQL; experience with API frameworks (Flask, FastAPI, Django) is a plus

• Expertise in designing and developing ETL and real-time streaming jobs (Apache Airflow preferred)

• Solid experience with real-time data processing and stream-processing systems, such as Apache Flink, RisingWave, and Apache Kafka

• Proficient in SQL and NoSQL databases; experience with TiDB, BigQuery, PostgreSQL, MySQL, and MongoDB is a plus

• Experience with cloud services such as AWS / GCP, especially data-related services

• Familiar with Linux/Unix environments and containerization tools such as Docker / Kubernetes

• It's a plus if you have experience in the e-commerce industry and strong skills in data analysis