Senior AI/ML Architect - Conversational AI

Company Description:

Hyly.AI is the multifamily industry’s premier Intelligence Fabric™, integrating Artificial, Business, and Human Intelligence into a single system designed to drive operational growth. By transforming raw data into actionable decisions and measurable results, Hyly.AI enables scalable operations without the need for additional resources. Founded in 2010, Hyly.AI has over a decade of experience in simplifying complex processes for multifamily leaders, helping them optimize efficiency and increase ROI. Trusted by 4 out of the top 5 NMHC managers, Hyly.AI empowers teams to focus on building meaningful communities rather than handling repetitive, manual tasks.

Role Description:

We are hiring a Senior AI/ML Architect – Agentic Conversational AI (6+ Years Experience | 100% Remote) to own and evolve the end-to-end AI architecture behind Hyly’s conversational platform. This is a hands-on architectural leadership role for someone with 6+ years of production AI/ML experience, including deep experience in:

• LLM orchestration & agentic workflows

• Retrieval-Augmented Generation (RAG) • Real-time, low-latency serving

• Evaluation-driven development

• Production observability and rollout safety. You will define how AI systems are designed, measured, deployed, and scaled across multiple channels.

Must Have Qualifications:

• 6+ years of professional AI/ML systems experience.
• 3+ years building conversational AI systems in production.
• Proven experience deploying LLM-based architectures (OpenAI, Claude, Llama/DeepSeek-class).
• Hands-on experience with agentic systems: ◦ Tool calling ◦ Structured outputs ◦ Policy control
• Strong RAG expertise with vector databases and reranking.
• Deep understanding of latency and cost optimization.
• Strong Python skills: experience with async services (Fast API preferred).
• MLOps experience: ◦ CI/CD ◦ Model & prompt versioning ◦ Containers and Kubernetes ◦ Feature flags and canary releases
• Strong systems design and cross-team leadership skills.
• Experience with observability in production AI systems.

Job Responsibilities:

Architecture & Platform Ownership

• Own the architecture of Hyly’s agentic conversational platform across chat, voice, SMS, and email.

• Define service boundaries, interface contracts, and scalability patterns.

• Ensure reliability, modularity, and extensibility.

Agentic Orchestration

• Design and evolve the orchestrator layer:

◦ Intent routing

◦ Tool schemas

◦ Policy enforcement

◦ Memory management

◦ Structured outputs

RAG & Knowledge Systems

• Build and standardize RAG pipelines:

◦ Hybrid retrieval

◦ Embeddings + reranking

◦ Grounded responses with citations

Performance & Cost Optimization

• Optimize real-time inference using:

◦ Keyword & semantic caching

◦ Streaming, batching, prompt compression

◦ Cost/latency trade-off analysis

Evaluation & Quality

• Establish eval-driven delivery:

◦ Offline and online benchmarks

◦ Regression detection

◦ Rollout gates tied to business metrics

• Ensure AI quality improves continuously—not just features.

Observability & Reliability

• Implement production-grade observability:

◦ Distributed tracing

◦ Error taxonomies

◦ SLOs and alerting

• Lead incident response and postmortems.

Leadership & Standards

• Mentor engineers and set AI architecture standards.

• Define best practices for versioning, rollouts, and documentation.

• Partner closely with Product, API, FE, and QA teams.

Nice to Have (Qualifications):

1. Remote Team Management Experience: Experience managing teams in a remote environment, ensuring effective communication and productivity.

2. Cross-Functional Team Leadership: Proven ability to lead cross-functional teams, managing dependencies and ensuring smooth coordination.

3. Strong collaborative development skills using Git and version control systems.