Skip to content

Commit de973c1

Browse files
committed
Use all of the clip
1 parent d7679c9 commit de973c1

File tree

1 file changed

+1
-3
lines changed

1 file changed

+1
-3
lines changed

conditioner.hpp

Lines changed: 1 addition & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -1096,9 +1096,7 @@ struct FluxCLIPEmbedder : public Conditioner {
10961096
size_t chunk_len_t5 = 256;
10971097
size_t chunk_count_t5 = t5_tokens.size() / chunk_len_t5;
10981098

1099-
// TODO: I believe chunk_count_l is actually bigger than chunk_count_t5
1100-
// So this ignores some tokens for clip
1101-
size_t chunk_count = chunk_count_t5;
1099+
size_t chunk_count = std::max(chunk_count_t5, chunk_count_l);
11021100

11031101
for (int chunk_idx = 0; chunk_idx < chunk_count; chunk_idx++) {
11041102
struct ggml_tensor* chunk_hidden_states_l = NULL; // [n_token, hidden_size_l]

0 commit comments

Comments
 (0)