Interface GPTConfig

Hyperparameters for the GPT model.

interface GPTConfig {
    blockSize: number;
    nEmbd: number;
    nHead: number;
    nLayer: number;
}

Properties

blockSize: number

Maximum context length of the attention window.

nEmbd: number

Embedding dimension (width).

nHead: number

Number of attention heads.

nLayer: number

Number of transformer layers (depth).