Skip to content

Added observability tests for PCI Spyre adapter#3192

Open
saijanani-c wants to merge 1 commit into
avocado-framework-tests:masterfrom
saijanani-c:spyre-observability
Open

Added observability tests for PCI Spyre adapter#3192
saijanani-c wants to merge 1 commit into
avocado-framework-tests:masterfrom
saijanani-c:spyre-observability

Conversation

@saijanani-c

@saijanani-c saijanani-c commented Jun 10, 2026

Copy link
Copy Markdown
Contributor

Added tests to validate AIU-SMI observability
functionality on Spyre AIU devices during
inferencing.

Features:

  • Creates a containerized VLLM environment
  • Starts continuous inference in the background
  • Captures aiu-smi metrics continuously for a specified duration
  • Validates that metrics are successfully captured and contain expected data
  • Displays all captured metrics in test logs for analysis

@saijanani-c saijanani-c force-pushed the spyre-observability branch from d32e6b6 to 79f6b64 Compare June 10, 2026 16:57
@saijanani-c

saijanani-c commented Jun 10, 2026

Copy link
Copy Markdown
Contributor Author

Logs:

Fetching asset from spyre_observability_tests.py:ObservabilityTests.test_aiu_smi
JOB ID : 6f8d92194eb3dbbd3c64934a9607757adb623341
JOB LOG : /root/avocado-fvt-wrapper/results/job-2026-06-10T22.06-6f8d921/job.log
(1/1) spyre_observability_tests.py:ObservabilityTests.test_aiu_smi;run-2c63: STARTED
(1/1) spyre_observability_tests.py:ObservabilityTests.test_aiu_smi;run-2c63: PASS (233.30 s)
RESULTS : PASS 1 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB HTML : /root/avocado-fvt-wrapper/results/job-2026-06-10T22.06-6f8d921/results.html
JOB TIME : 250.10 s

@saijanani-c saijanani-c force-pushed the spyre-observability branch from 79f6b64 to 8979066 Compare June 14, 2026 09:26
@saijanani-c

saijanani-c commented Jun 14, 2026

Copy link
Copy Markdown
Contributor Author

Logs:

Fetching asset from spyre_observability_tests.py:ObservabilityTests.test_aiu_smi
Fetching asset from spyre_observability_tests.py:ObservabilityTests.test_acelyzer
JOB ID : 08fa912e16b8812912098bf75e4bf3f54f884531
JOB LOG : /root/avocado-fvt-wrapper/results/job-2026-06-14T14.33-08fa912/job.log
(1/2) spyre_observability_tests.py:ObservabilityTests.test_aiu_smi;run-06af: STARTED
(1/2) spyre_observability_tests.py:ObservabilityTests.test_aiu_smi;run-06af: PASS (243.23 s)
(2/2) spyre_observability_tests.py:ObservabilityTests.test_acelyzer;run-06af: STARTED
(2/2) spyre_observability_tests.py:ObservabilityTests.test_acelyzer;run-06af: PASS (690.20 s)
RESULTS : PASS 2 | ERROR 0 | FAIL 0 | SKIP 0 | WARN 0 | INTERRUPT 0 | CANCEL 0
JOB HTML : /root/avocado-fvt-wrapper/results/job-2026-06-14T14.33-08fa912/results.html
JOB TIME : 952.04 s

@saijanani-c saijanani-c force-pushed the spyre-observability branch from 8979066 to cebcf4b Compare June 15, 2026 05:29
@saijanani-c
Added observability tests for PCI Spyre adapter
3a65bd1 
Added tests to validate AIU-SMI observability and
Acelyzer trace analysis functionality on Spyre AIU
devices during inferencing.

Features:

- Creates a containerized VLLM environment
- Starts continuous inference in the background
- Captures aiu-smi metrics continuously for a
  specified duration
- Validates that metrics are successfully captured
  and contain expected data
- Integrates Acelyzer (aiu-trace-analyzer) for
  post-processing JSON trace files
- Generates FLEX timing traces during inference
  workloads
- Analyzes traces with enhanced statistics for
  performance analysis
- Validates trace generation and successful acelyzer
  processing

Test Methods:
- test_aiu_smi_observability: Validates AIU-SMI metrics collection
- test_acelyzer: Validates trace generation and acelyzer analysis

Signed-off-by: Sai Janani C <jananic@linux.ibm.com>
@saijanani-c saijanani-c force-pushed the spyre-observability branch from cebcf4b to 3a65bd1 Compare June 15, 2026 05:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@saijanani-c