Remote Dev Jobs
1 jobs available
jetbrains · 🇩🇪 Berlin, GermanyRemote57y ago
<p>At JetBrains, code is our passion. Ever since we started, back in 2000, we've been striving to make the strongest, most effective developer tools on earth. Today, AI-powered coding agents are becoming a core part of how developers write Kotlin – and we want to make sure they write it well.</p> <p>The Kotlin AI Value Stream team is responsible for how AI agents understand, generate, and improve Kotlin code across all platforms: Android, Kotlin Multiplatform, server-side, web, desktop, and others. We build the evaluation infrastructure, error analysis tools, and post-training pipelines that measure and improve agent behavior on real Kotlin developer tasks.</p> <p>As a Research Engineer on this team, you'll own the end-to-end loop: Analyze how agents fail on Kotlin → build evals that capture those failures → research and implement methods to fix them → measure the improvement. Your work will directly shape how millions of developers experience Kotlin through AI coding agents.</p> <h2><strong>As part of our team, you will:</strong></h2> <p><strong>Build tools for agentic error analysis</strong></p> <ul> <li>Design and implement tooling to systematically capture, classify, and analyse errors that AI coding agents make when generating Kotlin code.</li> <li>Build observability pipelines over agentic traces – mining patterns from agent sessions in JetBrains IDEs, Junie, Claude Code, Cursor, and other coding agents.</li> </ul> <p><strong>Build evaluation pipelines</strong></p> <ul> <li>Design, implement, and maintain evaluation pipelines that measure Kotlin code generation quality across dimensions, including correctness, idiomaticity, build success, framework usage, and test coverage.</li> <li>Build simulation environments where coding agents can be measured on realistic Kotlin developer tasks – from greenfield KMP projects and Gradle dependency management to migrating Spring applications from Java to Kotlin.</li> <li>Own evaluation infrastructure: metrics, experiment tr