募集要項
- 募集背景
- An international IT consulting company is looking for a Data Engineer. The chosen candidate will work together with users and the project team to gather requirements and understand expectations. This role is based in Tokyo.
- 仕事内容
-
An international IT consulting company is looking for a Data Engineer.Responsibilities:
* Analyse business requirements and develop appropriate data solutions that meet functional and non-functional requirements
* Define the data architecture, structure, storage, and security model for data in various platforms
* Design and implement scalable data pipelines for processing large volumes of data
* Develop reusable frameworks for data ingestion, validation, normalisation, and transformation
* Automate unit testing and release processes through CI or CD pipeline
* Create scripts for operations, releases, data migrations, and data validations
Requirements:
* Experience in Hadoop ecosystem (HDFS, Hive, HBase, Phoenix, etc.)
* Excellent Scala and Spark programming skills
* Ability to design database schemas on data platform
* Understanding of Oracle database, MS-SQL Server, MongoDB, Kerberos, Linux, networking
* Skilled in SQL, shell scripting, git, unit testing, and CI or CD tools
* Proficient in Japanese and English
- 応募資格
-
- 必須
- Experience in Hadoop ecosystem (HDFS, Hive, HBase, Phoenix, etc.)
- 歓迎
- Excellent Scala and Spark programming skills
- 雇用形態
- 正社員
- 勤務地
- 東京都
- 年収・給与
- JPY7,000,000.00 - JPY9,500,000.00 （年収）
- 休日休暇
- weekends off, public holidays, paid holidays
