Data Engineer - Product Support

Job Responsibilities:

• Provide Level 2 support for Blendata Enterprise (Data Catalog, Workflow, Spark, Storage, DB)
• Investigate and resolve complex issues (e.g. Spark failure, S3 commit, DB connection, performance)
• Analyze logs (Spark, Airflow, application, database) to identify root cause
• Troubleshoot system performance across components (Spark, Airflow, Redis, DB)
• Handle escalations from Level 1 and communicate solutions to customers
• Work with Engineering team on bug fixing and solution validation
• Recommend performance tuning and best practices (Spark, DB, workflow)
• Support system stability during deployment, scaling, and upgrades

Qualifications:

Technical Skills

• Strong knowledge of Apache Spark (Driver, Executor, Shuffle, Memory)
• Experience with Spark on Kubernetes or YARN
• Familiar with S3 / HDFS / Data Lake / Parquet / Partitioning
• Experience with Airflow or workflow scheduling tools
• Knowledge of PostgreSQL / MySQL and connection pooling
• Good understanding of ETL / incremental processing / data pipeline

Programming & System

• Proficient in SQL
• Basic experience in Python or Scala
• Strong debugging and log analysis skills
• Knowledge of Linux and system performance tuning
• Understanding of network, memory, thread pool, retry mechanism
• Familiar with Redis is a plus

Soft Skills

• Strong analytical and problem-solving skills
• Able to explain technical issues clearly
• Able to work under pressure (production issues)
• Good teamwork and coordination skills
• Availabilities to on call or support case urgent