Kotlin extensions for LangChain4j

Link to the post: https://kpavlov.me/blog/kotlin-extensions-for-langchain4j/

?? Excited to announce v0.1.0 of Kotlin extensions for LangChain4j!

Ever struggled with blocking API calls in your AI-powered applications? This release transforms LangChain4j's synchronous API into a modern, non-blocking Kotlin experience.

You can enjoy:

• ? Kotlin Coroutine support for ChatLanguageModels
• ?? Kotlin Asynchronous Flow support for StreamingChatLanguageModels

?? Before:

// Blocking calls that tie up threads
val response = model.chat(request) // blocking thread here
println(response.content())        

? After:

// Non-blocking coroutines with structured concurrency
launch {
    val response = model.chatAsync(request) // suspend function, releasing thread
    println(response.content())
}        

?? And for streaming responses:

val messages =
    listOf(
        SystemMessage.from("You are helpful assistant"),
        UserMessage.from("Help me to write a post about Kotlin"),
    )
model
    .generateFlow(messages)
    .collect {
        logger.info("Received event: $it")
        when (it) {
            is Token -> {
                logger.info("Token: '${it.token}'") // consume token
            }
            is Completion -> logger.info("Response: '${it.response.content()}'") // consume response
            else -> fail("Unsupported event: $it") 
        }
    }        

Key Benefits of using Kotlin Coroutines:

• ?? Thread efficiency: Handle thousands of concurrent AI requests without thread exhaustion
• ?? Easy cancellation: Leverage structured concurrency for reliable cleanup
• ?? Better scalability: Non-blocking operations improve resource utilization
• ?? Idiomatic Kotlin: Seamless integration with other coroutine-based code
• ??Runs on oldie JVMs: Kotlin Coroutines were released as Generally Available (GA) with Kotlin 1.3 in October 2018, so you can run it on ancient JVM versions

Try it out:

https://github.com/kpavlov/langchain4j-kotlin

#Kotlin #AI #LangChain4j #Coroutines #OpenAI #SoftwareDevelopment #OpenSource #Programming