Network Operations Data Lab

A reproducible portfolio project that transforms sanitized infrastructure records into a small SQLite, SQL and data-quality workflow.

View repository · Read the full README · DataTideHH portfolio

Current implemented scope

The current verified source domain is a sanitized Cisco-oriented lab baseline.

Implemented artifacts:

A dedicated Proxmox host and live API source do not currently exist. The separate Proxmox repository contains a validated pre-hardware design only.

End-to-end workflow

public-safe CSV source tables
            |
            v
Python contract validation
            |
            v
SQLite keys, constraints and relationships
            |
            v
SQL analysis and quality views
            |
            v
aggregated public-safe report
            |
            v
Power BI report concept

The workflow uses only the Python standard library.

Current data model

Table Grain Key
devices one row per synthetic infrastructure device device_id
interfaces one row per interface in the current baseline interface_id
topology_links one row per directed documented relationship link_id
data_quality_report one row per executed reporting rule check number plus name

The current source is a static baseline rather than a historical monitoring feed.

Read the data-model specification

Quality semantics

The report distinguishes:

Category Status Meaning
data_quality OK / FAIL validity, completeness, uniqueness and relationships
operational_condition OK / WARN plausible operational state requiring review
summary INFO descriptive counts

The committed sample has no data-quality failures and one intentional operational warning for an administratively enabled interface that is operationally down.

Read the data-quality rules

SQLite and SQL

The implemented database layer includes:

Source files:

SQLite binaries remain local and are not committed.

Reproduce locally

python -m scripts.load_sample_data
python -m scripts.build_sqlite_database
python -m scripts.run_sqlite_analysis
python -m scripts.run_data_quality_checks
python -m unittest discover -s tests -p "test_*.py" -v

The committed report is regenerated in CI and compared with the repository version.

Portfolio evidence

Artifact Evidence
Project scope boundaries and current implementation status
Data model grain, keys, relationships and controlled values
Data-quality rules hard validation and reporting semantics
Cisco baseline source context without private raw output
Lab topology current data path and future cross-layer design
VLAN roadmap aligned VLAN 10/20/30/99/998/999 roles
Proxmox roadmap future source integration without live claims
Power BI concept report questions, pages, measures and limitations
Quality report reproducible aggregated output
Tests executable workflow verification

Public-safety boundary

The repository does not publish real:

Only synthetic and aggregated public-safe records are committed.

Power BI status

No .pbix or .pbit file is published.

The current artifact is a reviewed report concept covering:

  1. Infrastructure Overview
  2. Interface Operations
  3. Topology Coverage
  4. Data Quality

A screenshot should be published only after a local model is stable and privacy-reviewed.

Next substantive milestone

The Cisco-based static workflow is complete for its current scope.

The next useful portfolio step is a small local Power BI prototype based on the SQLite model. Proxmox integration begins only after dedicated hardware exists and private source fields have been reviewed.