parameters method

  1. @override
List<Tensor> parameters()
override

Trainable tensors owned by this module (and its submodules).

Implementation

@override
List<Tensor> parameters() => [
  ...attnLn.parameters(),
  for (final l in qHeads) ...l.parameters(),
  for (final l in kHeads) ...l.parameters(),
  for (final l in vHeads) ...l.parameters(),
  ...outProj.parameters(),
  ...crossAttnLn.parameters(),
  for (final l in crossQHeads) ...l.parameters(),
  for (final l in crossKHeads) ...l.parameters(),
  for (final l in crossVHeads) ...l.parameters(),
  ...crossOutProj.parameters(),
  ...mlpLn.parameters(),
  ...mlp0.parameters(),
  ...mlp2.parameters(),
];