DataProfiler Performance Dashboard

Latest Benchmark Results Active

Comprehensive performance analysis with unified infrastructure, domain-specific tests, and statistical rigor framework.

Full Report Unified Analysis Domain Testing Statistical Report External Comparison Workflow Logs

🏃 Unified Performance Metrics

Core engine performance:

                          time:   [9.2598 ms 9.2816 ms 9.3075 ms]
                          thrpt:  [12.531 MiB/s 12.566 MiB/s 12.596 MiB/s]
                          time:   [23.956 ms 23.987 ms 24.020 ms]
                          thrpt:  [22.570 MiB/s 22.601 MiB/s 22.630 MiB/s]
                          time:   [7.6015 ms 7.6240 ms 7.6516 ms]

🏢 Domain-Specific Performance

Domain testing results:

                          time:   [125.25 ms 125.53 ms 125.84 ms]
                          thrpt:  [33.989 MiB/s 34.072 MiB/s 34.150 MiB/s]
                          time:   [85.442 ms 85.996 ms 86.693 ms]
                          thrpt:  [27.007 MiB/s 27.226 MiB/s 27.403 MiB/s]
                          time:   [618.88 ms 620.02 ms 621.04 ms]

📊 Statistical Rigor Metrics

Statistical analysis performance:

                          time:   [1.1083 µs 1.1108 µs 1.1143 µs]
                          time:   [1.0698 µs 1.0703 µs 1.0708 µs]
                          time:   [1.1070 µs 1.1116 µs 1.1166 µs]
                          time:   [1.0820 µs 1.0832 µs 1.0846 µs]
                          time:   [1.0600 µs 1.0605 µs 1.0610 µs]

Benchmark System Architecture

Modern benchmarking infrastructure with statistical rigor and comprehensive testing coverage.

Unified Infrastructure: Consolidated from fragmented benchmark files
Domain-Specific Tests: Transactions, TimeSeries, Streaming data patterns
Standardized Datasets: 7 realistic patterns (Basic, Mixed, Numeric, Wide, Deep, Unicode, Messy)
JSON Result Collection: Structured data for CI/CD integration
Statistical Rigor Framework: 95% confidence intervals, outlier detection, regression analysis
Engine Selection Testing: AdaptiveProfiler accuracy validation (target 85%)

Statistical Rigor Framework New

Advanced statistical analysis ensuring reliable performance measurements and regression detection.

95%

Confidence Intervals

IQR

Outlier Detection

<5%

Target CV

85%

Engine Accuracy Target

Performance Validation Results

Automated validation of DataProfiler's performance claims through comprehensive CI benchmarks comparing against pandas, polars, and other tools.

🚀 DataProfiler Performance Comparison
==================================================
Environment: CI
Testing file sizes: [1, 2, 5]MB
==================== 1MB TEST ====================