check_dimensionality
Assess data dimensionality and clustering tendency using PCA variance curves and Hopkins statistic, revealing intrinsic dimensions and cluster feasibility.
Instructions
PCA-based dimensionality + Hopkins clustering tendency (Level 3).
Standardizes the numeric matrix, runs SVD-based PCA. Returns variance-
explained curve, intrinsic dim (95% / 99% cumulative variance), effective
rank (entropy of variance shares), and Hopkins statistic (0.5 random,
>0.75 clustered, <0.3 grid-like). Caps at 50 features.
Output size: small.
Input Schema
| Name | Required | Description | Default |
|---|---|---|---|
| columns | No | ||
| source_id | Yes |
Output Schema
| Name | Required | Description | Default |
|---|---|---|---|
No arguments | |||