We offer a diverse range of opportunities across the health, education, and entertainment industries.
Our innovative teams are driving the future of consumer-led products, and we're always looking for passionate individuals to join us.
Learn more about our story at: About the role At RubyLabs, we’re seeking a senior AI Engineer (Node.
js / TypeScript) to shape our AI infrastructure and drive production-ready LLM experiences.
You’ll work in a modern stack, making data-driven decisions around model performance, reliability, and cost.
You’ll own advanced prompt systems, structured outputs, and complex LLM workflows using LangChain or LlamaIndex.
Observability, debugging, and evaluation are core to the role, leveraging Langfuse and AI gateways like OpenRouter to continuously improve model quality and operational efficiency.
You’ll take full ownership of key AI features from experimentation to live production.
Structured Outputs & Schemas: Implementing various response schemes (JSON mode, function calling, Zod/JSON schemas) to ensure AI outputs are predictable and ready for seamless integration into application logic.
Prompt Engineering & Evaluations: Building robust evaluation pipelines and using Langfuse to collect feedback and score the quality of responses in real time.
Tracing & Debugging: Performing deep debugging of complex LLM chains using Langfuse traces to identify bottlenecks and optimize for cost, latency, and context window usage.
AI A/B Testing: Running systematic experiments across different models via OpenRouter (e.
, comparing Claude 3.
5 Sonnet vs.
GPT-4o) and analyzing results based on qua.