AttributeError: 'NoneType' object has no attribute 'device'

[WindChimeRan]

I tried to finetune GoLLIE-7b on crossner-ai.

bash bash_scripts/generate_data.sh
bash bash_scripts/GoLLIE-7B_CodeLLaMA.sh 

I only trimmed the yaml to below:

train_tasks:
  - crossner.crossner_ai
validation_tasks:
  - crossner.crossner_ai
test_tasks:
  - crossner.crossner_ai

I got this error:

GoLLIE/src/model/patch_models/modeling_flash_llama.py", line 178, in _update_cos_sin_cache
    or self._cos_cached.device != device
AttributeError: 'NoneType' object has no attribute 'device'

GoLLIE/src/model/patch_models/modeling_flash_llama.py

Lines 164 to 181 in ca0edff

	self._cos_cached = None
	self._sin_cached = None
	self._cos_k_cached = None
	self._sin_k_cached = None
	def _compute_inv_freq(self, device=None):
	return 1 / (self.base ** (torch.arange(0, self.dim, 2, device=device, dtype=torch.float32) / self.dim))
	def _update_cos_sin_cache(self, seqlen, device=None, dtype=None):
	# Reset the tables if the sequence length has changed,
	# if we're on a new device (possibly due to tracing for instance),
	# or if we're switching from inference mode to training
	if (
	seqlen > self._seq_len_cached
	or self._cos_cached.device != device
	or self._cos_cached.dtype != dtype
	or (self.training and self._cos_cached.is_inference())
	):

I checked the code, and the self._cos_cached is indeed None in the init ...