prithivMLmods commited on
Commit
1ea3f31
1 Parent(s): 1f95db9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -1
README.md CHANGED
@@ -110,7 +110,15 @@ output_text = processor.batch_decode(
110
  )
111
  print(output_text)
112
  ```
113
-
 
 
 
 
 
 
 
 
114
  ### **Key Features**
115
 
116
  1. **Vision-Language Integration:**
 
110
  )
111
  print(output_text)
112
  ```
113
+ ### Buf
114
+ ```python
115
+ buffer = ""
116
+ for new_text in streamer:
117
+ buffer += new_text
118
+ # Remove <|im_end|> or similar tokens from the output
119
+ buffer = buffer.replace("<|im_end|>", "")
120
+ yield buffer
121
+ ```
122
  ### **Key Features**
123
 
124
  1. **Vision-Language Integration:**