Data Engineer - IT Company

勤務地 東京都
雇用形態 派遣
給与 ¥3000000.00 - ¥7000000.00 (年収)
専門 テクノロジー・デジタル・通信,
職種 データベースエンジニア/管理者,
お問合せ takamasa ono
JOB ID JO-2208-473444
about takamasa ono

MANDATORY
・Applicants must have permission to work in Japan
・Applicants must be able to speak fluent ~ native level Japanese (Equivalent to JLPT N1)
☑Japanese global company☑Listed company☑English language required ☑Japanese language required☑Hybrid (On-site x Remote)

[Position]
Data Engineer

[Company Description]
Japanese IT Company

[Responsibilities]

  • Build large batch data pipelines using data processing frameworks and technologies such as Spark, Hive, Kafka, Spark-Streaming, and Hadoop.
  • Leverage the data pipeline to provide key decision-making data for data checks, customer acquisition, and other key business performance indicators in line with the company guidelines.

Work Environment

  • Python / Hadoop / Hive / Spark / Kafka
  • CCBD employs around 300 people now. Team size is 2-6.

[Requirements]

  • Hadoop, Spark, Kafka application development, operational experience
  • Development experience with Python or Java / Scala
  • Over 5 years of data engineer experience
  • Advanced SQL knowledge and relational database experience
  • Experience in building data pipelines, datasets and optimizing performance
  • Data modeling experience
  • Experience developing applications for a Linux environment
  • Being able to read, write and speak Japanese (native level)
  • Being able to read, write and speak English (daily conversation level)

[Language Requirement]

  • English Language level: Business level
  • Japanese Language level: Fluent - Native Level (Equivalent to JLPT N1)
  • Work permission in Japan required

[Preferred Knowledge, Skills and Abilities]

  • Development experience utilizing big data
  • Database operation experience, optimal performance tuning experience
  • Experience in infrastructure management such as Docker and Kubernetes
  • Deep understanding and experience of DevOps / Micro service architecture
  • Operational experience with Jenkins or other CI technologies
  • Scrum / Agile development experience
  • Experience building a system using the cloud (AWS, GCP, etc)

[Working days /Time]
9:00-17:30

[Salary]
3~7 Million yen(Experiences and skills will be considered)

[Contract type]
Haken

[Location]
Tokyo



Please click "apply" if you are interested in the job.
We will review your profile and contact you within five business days should we find that you satisfy the requirements of the hiring company.
Further details about the company and position will be notified at a later date.



Reference: JO-2208-473444
#LI-Hybrid
Seniority Level: Associate~Mid-Senior level
Job Function: Information Technology, Administrative