[CERT-TEST-FAILURE] TC-CNET-4.11: Script fails due to import compatibility issue, missing _cq_excluded_attr_ids, and insufficient step logging

[Pradeep-grl]

Test Case

TC-CNET-4.11

Description

TC-CNET-4.11 was automated through PR #39311. The test case was validated on Master ToT using the ESP platform.

During the initial validation, the script failed to launch with the following error:

Traceback (most recent call last):
File "/home/ubuntu/master/connectedhomeip/src/python_testing/TC_CNET_4_11.py", line 33, in
from matter.testing.matter_testing import MatterBaseTest, TestStep, default_matter_test_main, has_feature, run_if_endpoint_matches
ImportError: cannot import name 'default_matter_test_main' from 'matter.testing.matter_testing' (/home/ubuntu/matter-sdk-master-eefbb539d-arm64/chip_env/lib/python3.12/site-packages/matter/testing/matter_testing.py)

After debugging, line 33 in the script, imports were updated as follows to match the current Matter Python framework:

from matter.testing.decorators import has_feature, run_if_endpoint_matches
from matter.testing.runner import TestStep, default_matter_test_main
from matter.testing.matter_testing import MatterBaseTest

With these changes, the script executed further but failed at Step 20 with the following error:

Test test_TC_CNET_4_11 failed for the following reason:

• 'TC_CNET_4_11' object has no attribute '_cq_excluded_attr_ids'
• File "/home/grl/master_jul/connectedhomeip/no/lib/python3.12/site-packages/matter/testing/matter_testing.py", line 734, in _start_wildcard_subscription
• AttributeError: 'TC_CNET_4_11' object has no attribute '_cq_excluded_attr_ids'
• Test step:

• 20: TH reads Networks attribute from the DUT	Expected outcome:  Verify that the Networks attribute list has an entry with the following fields: 1. NetworkID is the hex representation of the ASCII values for PIXIT.CNET.WIFI_2ND_ACCESSPOINT_SSID 2. Connected is of type bool and is TRUE
  

• Endpoint: 0

Additionally, the script does not log the execution of Steps 1–19, making it difficult to identify the test progression during execution. So the script can be enhanced to provide step-wise logging for all test steps.

Command Used:
python3 src/python_testing/TC_CNET_4_11.py --commissioning-method ble-wifi --wifi-ssid <SSID1> --wifi-passphrase <Passphrase1> --discriminator 3840 --passcode 20202021 --string-arg PIXIT.CNET.WIFI_2ND_ACCESSPOINT_SSID:"SSID2" --string-arg PIXIT.CNET.WIFI_2ND_ACCESSPOINT_CREDENTIALS:"Passphrase2" --endpoint 0

Device Used: ESP32C3

Bug prevalence

Whenever I do this.

GitHub hash of the SDK that was being used

ce681e3

Platform

esp32

Reference Logs:

Controller Log: TC-CNET-4_11-Controller_log.txt
DUT Log: TC-CNET-4_11-DUT_log.txt

[Pradeep-grl]

@aabgd , Could you please take a look at this issue?