protomotions.agents.peft.config module

Parameter-efficient fine-tuning configuration.

class protomotions.agents.peft.config.TransformerPEFTConfig(peft_type='dora', rank=4, alpha=0.5)

Bases: object

Parameter-efficient adapter config for transformer layers.

Attributes:

peft_type: ‘lora’ or ‘dora’. rank: Adapter rank. alpha: Adapter scaling factor.

peft_type: str = 'dora'

rank: int = 4

alpha: float = 0.5

__init__(peft_type='dora', rank=4, alpha=0.5)