Base in Shenzhen, remote work

Job Responsibilities:

• Leverage vast web3 data to extract data value, establish user profiles and blockchain profile data systems, and continuously optimize data models.
• Familiarity with on-chain data integration and parsing processes, as well as centralized storage optimization.
• Conduct real-time and offline data validation to ensure data quality.
• Build on-chain data platforms (primarily using Java), including architecture and solution design.
• Optimize storage and query pathways for massive data volumes. Provide systematic reconstruction plans for the existing data architecture.

Job Requirements:

• Familiar with common big data storage engines and message middleware, including but not limited to ES, ClickHouse, Hbase, Kafka, Redis, etc.
• Knowledgeable about general distributed systems, including Hadoop, HDFS, Spark, etc., and able to write efficient data cleaning tasks using distributed engines.
• Familiar with the real-time processing engine Flink, capable of optimizing large Flink tasks from multiple perspectives, including execution plans, resource configuration, parameter tuning, and underlying source code.
• Experience in data governance scenarios, able to identify existing data issues through various means.
• Data quality management with a systematic management plan, and participation in the development of the data quality management platform DQC.
• Proficient in the Java technology stack, including open-source frameworks such as Spring Cloud and MyBatis.
• Familiar with JVM optimization theories for optimizing and diagnosing existing data platforms.

Preferred Qualifications:

• Experience with user profiling systems.
• Experience in high-quality data mining (based on strategy algorithms, machine learning, etc.).