Skip to content

Commit 4ab7ce0

Browse files
authored
Update readme (#79)
Signed-off-by: kerthcet <kerthcet@gmail.com>
1 parent 9a9e264 commit 4ab7ce0

1 file changed

Lines changed: 4 additions & 2 deletions

File tree

README.md

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -17,7 +17,7 @@ Thanks to [async-openai](https://github.com/64bit/async-openai), AMRS builds on
1717

1818
## How to use
1919

20-
Here's a simple example with random routing mode:
20+
Here's a simple example with the Weighted Round Robin (WRR) routing mode:
2121

2222

2323
```rust
@@ -28,16 +28,18 @@ use arms::{Client, Config, ModelConfig, CreateResponseArgs, RoutingMode};
2828

2929
let config = Config::builder()
3030
.provider("openai")
31-
.routing_mode(RoutingMode::Random)
31+
.routing_mode(RoutingMode::WRR)
3232
.model(
3333
ModelConfig::builder()
3434
.id("gpt-3.5-turbo")
35+
.weight(2)
3536
.build()
3637
.unwrap(),
3738
)
3839
.model(
3940
ModelConfig::builder()
4041
.id("gpt-4")
42+
.weight(1)
4143
.build()
4244
.unwrap(),
4345
)

0 commit comments

Comments
 (0)