Datasets
| dataset | what we use | size | licence / terms | citation |
|---|---|---|---|---|
| CIC-IDS2017 | MachineLearningCSV.zip (CICFlowMeter features, 8 day files, 2,830,743 flows, 14 attack classes). 11 columns mapped into the schema; 530,897 exact duplicates dropped; 10 % per-class sample with a floor of 5,000 (rare classes kept whole) = 253,259 flows, 25.7 % attacks; stratified 70/30 split. |
235 MB zip, 885 MB CSV | Free for research with citation, per the Canadian Institute for Cybersecurity (UNB) | Sharafaldin, Lashkari, Ghorbani. Toward Generating a New Intrusion Detection Dataset and Intrusion Traffic Characterization. ICISSP 2018 |
| UNSW-NB15 | Official partition: training set 175,341 flows, testing set 82,332 flows (10 classes). 22 features (14 direct, 2 protocol flags, 6 derived). | 48 MB | Free for academic research with citation, per UNSW Canberra Cyber | Moustafa, Slay. UNSW-NB15: a comprehensive data set for network intrusion detection systems. MilCIS 2015 |
Official hosts gate downloads behind forms, so scripts/download_*.py fetch third-party
mirrors from the Hugging Face Hub (not checked byte-for-byte against the official archives; row
counts match the official releases: 2,830,743 CIC flows, 175,341 / 82,332 UNSW flows), resume
interrupted transfers and verify SHA-256 against the pinned hashes (ADR 0006). Datasets are
never committed; tests/fixtures/ holds ~930 sampled rows for CI.
See also ADR 0006.