Getting No log in validation_loss

[John6666]

Perhaps this?

'No Log' for validation loss during training with Trainer

Hello, I’m trying to fine-tune a Custom BertModel on a sequence classification task, but I’m having some issues getting the Trainer to log the validation loss. Specifically, the log looks like this: [no_log] Here is the code I’m using: from datasets import load_dataset import torch.nn as nn from transformers import ( AutoModel, AutoModelForSequenceClassification, AutoTokenizer, DataCollatorWithPadding, Trainer, TrainingArguments ) class CustomTrainer(Trainer):…

For LLM validation loss you might also need label_names=[] in the TrainingArguments and set trainer.can_return_loss = True to satisfy transformers/src/transformers/trainer.py at v4.40.2 · huggingface/transformers · GitHub for some models.