Fix a tiny bug

forgot to add  in base_model.py

Author: sadra-barikbin

src/lighteval/models/base_model.py

@@ -553,7 +553,7 @@ def greedy_until(
                         max_length=self.max_length - 1,
                         add_special_tokens=self.add_special_tokens,
                         return_dict=True,
-                    )
+                    ).to(self.device)
                 else:
                     # See doc https://huggingface.co/docs/transformers/v4.38.2/en/pad_truncation#padding-and-truncation
                     # Will do left truncation and padding, as defined when creating the tokenizer