1. Perform IT system architecture design, new technology research, and provide recommendation.
2. Design and implement optimal data pipeline architecture (considered high data volume, data governance, etc.).
3. Work with PRODUCT/BIZ teams to assist with new data platform re-engineering or data-related technical issues.
4. DataOps high availability NoSQL DB (e.g.: Cassandra, S3/MinIO, MariaDB, etc.) on K8s environment.
Job Qualifications
Required Qualifications:
1. B.S. degree and above in Computer Science or related fields (Information Engineering, Information Management, Data engineering, Applied Mathematics).
2. Experience in Hadoop ecosystem and SQL NoSQL databases.
3. Big Data Solutions development, data pipelines for batch and streaming applications.
4. Knowledge of object stores for image and semi/unstructured data.
5. Metadata management, data quality assurance, data security and governance, and new data technology evaluation and enablement.
6. Strong analytical, problem solving, and organizational skills.
7. Self-motivated with the ability to work under minimal supervision.
Preferred Qualifications:
1. Experience in MongoDB, MariaDB, Cassandra, and MinIO(S3).
2. Data orchestration among various data sources, data parallel processing.
3. Ability to design solutions independently based on high-level architecture.
4. Cloud native deployment practices, specifically, containers and container orchestration platforms.
Personal Attributes:
Musk’s Orbital Compute Vision: TERAFAB and the End of the Terrestrial Data Center