Senior Software Engineer (Machine Learning Services & Platform)

Job ID: 06521

Senior Software Engineer (ML Services & Platform)

Tokyo, Japan | Full Remote

Annual Salary: JPY 6,000,000 – 12,000,000

Employment Type: Full-time

About the Company

A fast-growing technology startup delivering sales enablement SaaS through the integration of AI, voice, and cloud technologies. The company’s core platform analyzes real-time conversations to help organizations improve sales and customer success performance.

Founded in 2017 and headquartered in Tokyo, the company has grown to over 200 team members and operates with a fully remote, fully flexible work model. Its products are used by more than 10,000 companies globally, with strong adoption across Japan, Southeast Asia, and the United States.

All core technologies are developed in-house, including voice recognition, transcription, and emotion analysis. The company holds the top share in Japan’s cloud-based conversational AI market and was ranked No.1 in Deloitte’s Technology Fast 50 Japan.

Role Overview

As a Senior Software Engineer in the ML Services & Platform team, you will design and build large-scale, distributed systems that power real-time voice-based AI services. You will work closely with machine learning researchers and platform engineers to bring cutting-edge multimodal AI into production.

This role is ideal for engineers who enjoy solving complex infrastructure and MLOps challenges at scale.

Key Responsibilities

• Design and implement architecture for large-scale distributed systems with a focus on reliability and scalability

• Build and optimize cloud-native infrastructure for cost efficiency and performance

• Develop and maintain MLOps pipelines for continuous model training, deployment, and monitoring

• Design real-time data processing and analytics platforms

• Collaborate with AI research teams to prototype and productionize new features

• Design high-availability, low-latency systems to support global expansion

Why Join

• Work on early-stage, real-world implementation of multimodal AI in B2B products

• Collaborate with research teams publishing and presenting at international conferences

• Gain experience handling over one million analysis requests per day

• Build expertise in real-time data processing technologies

• Play an autonomous role while working alongside senior engineers in a fully remote environment

Tech Stack

Backend: Python (Django), Elasticsearch

Frontend: React, Vue.jsFrontend: React,

Machine Learning: TensorFlow, Keras, PyTorch

Data Processing: Real-time streaming and analytics

Communication: SIP, VoIP, WebRTC, WebSocket

Infrastructure: AWS, Google Cloud, Terraform

Mobile: Kotlin, Swift, Flutter

Tools: Slack, GitHub, Confluence

Required Qualifications

• Over 3 years of experience building distributed systems on cloud platforms, especially AWS

• Strong experience with Kubernetes or similar container orchestration tools

• Hands-on experience designing CI/CD pipelines

• Advanced programming skills in Python or equivalent languages

• Experience with performance tuning and cost optimization at scale

Preferred Qualifications

• Experience building machine learning or MLOps systems

• Background in speech processing or natural language processing

• Experience with microservices or serverless architectures

• Experience with large-scale data processing frameworks such as Spark or Kafka

• Contributions to open-source projects

• Conversational-level English or higher (used in team meetings)

Ideal Candidate Profile

• Aligns with the company’s mission and values

• Strong logical thinking and problem-solving skills

• Collaborative and team-oriented mindset

• Proactive, self-driven, and eager to grow technically

We still have more positions available across different roles. If this isn’t the perfect fit, explore our other openings and feel free to apply!