1% curl "localhost:8080/ai/simple?message=Tell%20me%20a%20joke"
 2  Sure, here's one for you:
 3
 4Why couldn't the bicycle stand up by itself?
 5
 6Because it was two-tired!
 7
 8Get it? Two-tired... like a bicycle tire... ha ha ha!
 9
10Hope that brought a smile to your face!

 1% time curl "localhost:8080/ai/simple?message=Tell%20me%20a%20very%20long%20joke"
 2  Sure! Here's a very long joke for you:
 3
 4One day, a man walked into a library and asked the librarian, "Do you have any books on Pavlov's dogs and Schrödinger's cat?"
 5
 6The librarian replied, "It rings a bell, but I'm not sure if it's here or not."
 7
 8The man thought for a moment and said, "Well, I'm looking for a book that explores the concept of conditioned response and the idea that a cat can be both alive and dead at the same time."
 9
10The librarian scratched her head and said, "Let me see... I think I have just the book for you. It's called 'Pavlov's Cats and Schrödinger's Dogs.'"
11
12The man's eyes widened in surprise and he exclaimed, "That's exactly what I'm looking for! But can I find it on the shelf?"
13
14The librarian smiled and said, "It's a bit of a puzzle, but if you look carefully, you should be able to find it. Just remember, the book is neither here nor there, but it's definitely somewhere in the library."
15
16The man thought for a moment and then asked, "But how do I know if I've found the right book if it's both here and not here at the same time?"
17
18The librarian chuckled and said, "Well, that's the million-dollar question. But I think you'll know it when you see it. The book will be neither on the shelf nor not on the shelf, but somewhere in between. And when you open it, you'll see that it's both a book about Pavlov's dogs and Schrödinger's cat, and yet, it's not either of those things at the same time. It's a bit of a paradox, but that's the beauty of it."
19
20The man nodded thoughtfully and began to search the shelves, determined to find the elusive book. After a few minutes of searching, he finally found it nestled between two other books that were neither here nor there. He opened it up and was amazed to find that it was both a book about Pavlov's dogs and Schrödinger's cat, and yet, it was neither of those things at the same time.
21
22The end.
23
24I hope that long joke brought a smile to your face!
25curl "localhost:8080/ai/simple?message=Tell%20me%20a%20very%20long%20joke"  0.00s user 0.01s system 0% cpu 13.769 total

1        <dependency>
2            <groupId>org.springframework.boot</groupId>
3            <artifactId>spring-boot-starter-web</artifactId>
4        </dependency>
5        <dependency>
6            <groupId>org.springframework.boot</groupId>
7            <artifactId>spring-boot-starter-webflux</artifactId>
8        </dependency>

 1public class MyOpenAiClient extends OpenAiClient {
 2
 3    private final OpenAiService openAiService;
 4
 5    public MyOpenAiClient(OpenAiService openAiService) {
 6        super(openAiService);
 7        this.openAiService = openAiService;
 8    }
 9
10    public Flowable<String> generateStream(String prompt) {
11
12        ChatCompletionRequest completionRequest = ChatCompletionRequest.builder()
13                .model(super.getModel())
14                .temperature(super.getTemperature())
15                .messages(List.of(new ChatMessage("user", prompt)))
16                .build();
17
18        return openAiService.streamChatCompletion(completionRequest)
19                .filter(completionChunk ->
20                        completionChunk.getChoices().get(0) != null && completionChunk.getChoices().get(0).getMessage() != null && completionChunk.getChoices().get(0).getMessage().getContent() != null).map(
21                        completionChunk -> completionChunk.getChoices().get(0).getMessage().getContent());
22    }
23
24}

 1@RestController
 2public class SimpleController {
 3
 4    private final MyOpenAiClient aiClient;
 5
 6    public SimpleController(MyOpenAiClient aiClient) {
 7        this.aiClient = aiClient;
 8    }
 9
10    @GetMapping(path = "/ai/stream", produces = MediaType.TEXT_EVENT_STREAM_VALUE)
11    public Flowable<String> streamCompletion(@RequestParam(value = "message", defaultValue = "Tell me a very long joke") String message) {
12        return aiClient.generateStream(message);
13    }
14}

 1machih@machihXCV5C StreamSpringExample % time curl "localhost:8080/ai/stream?message=Tell%20me%20a%20very%20long%20joke" -H 'accept: text/event-stream'
 2data: 
 3
 4data: Sure
 5
 6data:,
 7
 8data: here
 9
10data:'
11
12data:s
13
14data: a
15
16data: very
17
18data: long
19
20data: jo
21
22data:ke
23
24data: for
25
26...