Lead Data Engineer

Job Description

Appealing Points:

• Opportunity to design and build highly scalable data pipelines using modern technologies like Spark and Scala.
• Exposure to cutting-edge cloud platforms such as Azure and tools for CI/CD automation.
• Collaborative work environment with strong emphasis on innovation, problem-solving, and continuous learning.​​​​​​

Annual Salary: 10 million yen and above

Job Description:

• Collaborate with users and project team on requirements and expectations
• Analyze business requirements, create proper data solutions that meets functional and non-functional requirements
• Design and implement highly scalable and robust data pipelines in Scala/Spark/Java for processing of extreme large amount of data
• Create and maintain reusable frameworks for data ingestion, validation, normalization, and transformation
• Create scripts for test automation, CI/CD, data migrations, data validations
• Provide technical support for incident recovery

Job Qualification:

• Minimum 3~6 years of working experience as developer or data engineer
• Strong programming skills and has software development experience in Scala, Java or Python
• Deep understanding of distributed systems (Hadoop, Spark, etc.) and its optimization
• Experience in public cloud technologies, preferably Azure
• Good knowledge of Oracle database, MS-SQL Server, Linux, networking
• Proficient in SQL, shell scripting, git, unit testing, CI/CD tools
• Understanding of design principles, coding standards and best practices
• Strong learning ability and problem-solving skills
• Excellent communication, presentation, and interpersonal skills

Preferred Qualification:

• Understanding of REST API, NoSQL, micro-services, ETL
• Hand-on experience with Cloud services is preferred
• Understanding of streaming data processing and change data capture is preferred
• Experience with BI tools is preferred

Personality:

• Detailed and precise, able to drive alone the design and development of complex system.
• Able to articulate technical aspects in an easy-to-understand way for non-developers
• Strong performer with focus on delivery, fast learning and able to apply his knowledge in various domains.
• Willing to learn new technologies and pick up challenging work
• Team player

Language Requirements: Business level Japanese (N2) & Business English conversation skill.

Benefits:

• Annual salary increase
• Bonus once a year
• Complete social insurance
• Full payment of transportation expenses
• Kanto IT Software Health Association
• E-learning available
• Orientation for new employees
• Available for training programs (domestic and overseas)

Company Description:

This company is one of the largest IT consulting companies in Europe, with more than 200,000 employees based in locations in over 40 countries.

As a global leader in consulting, technology services and digital transformation, they were established in 2013 as a Japanese corporation of the world's leading IT consulting company at the forefront of innovation, and they offer a wide range of integrated services with the highest level of technology and abundant expertise.

[Passive smoking measures]

Indoor smoking

Designated smoking area