Back to validation page.
Feature |
Release 0.41 + Makefile patchPass/Fail |
| Features defined by 802.11 | |
|
Driver load
Hardware - ipw2100 laptop with 802.11b wireless capabilities. Most tests assume you have loaded the firmware as described in INSTALL before attempting to load the driver. They also assume the driver is not currently loaded. Tests also assume you are using eth1 and that eth1 is not up. All tests below are performed as root on laptop. Steps specific to Averatec models are shown in blue. |
Using Averatec 5110H. Using Fedora Core release 1. Using 2.6.5 kernel. Using wireless tools version 27. |
|
modprobe
tests
% lsmod |
grep ipw2100
<- Verify
ipw2100 module is not loaded. |
Pass Issues ISSUE 935969 in DB This issue is still being seen in 0.41. |
|
insmod
tests
% lsmod |
grep ipw2100
<- Verify
ipw2100 module is not loaded. |
Pass Issues Same issue as above. |
|
Timing
of av5100 load
% lsmod | grep ipw2100
<- Verify
ipw2100 module is not loaded. |
Pass Issues ISSUE 931396 in DB - See this whenever I need to manually do the 'ifup eth1' |
|
Insert/Remove ipw2100
without already having inserted av5100
% lsmod | grep
ipw2100
<- Verify
ipw2100 module is not loaded. Note: Test twice. Once with a long delay between second and third step and once with no delay. |
Pass Issues No issues on the long delay test, but seeing the same issues on the no delay test. However, dmesg output is not as severe (before it was showing module loading and unloading multiple times). --> IS THIS IN THE BUG DB? IF NOT, NEED TO PUT IT IN. I'M SEEING THE SAME STUFF. |
|
Network interface
timing tests 1
% ifdown eth1
<- Bring network interface down before test. |
Pass Issues Same 'ifup eth1' issue as before. |
|
Network interface
timing tests 2
% ifdown eth1
<- Bring interface down |
NOT ATTEMPTING (until fixed) ISSUE 935966 in DB Notes: If I try to do an ifup eth1 afterwards, I get the error: ipw2100 device eth1 does not seem to be present, delaying initialization This is the message I see the first time I try to do the ifup eth1 as well. If I try to do an ifdown eth1, I get the error: SIOCGIFFLAGS: No such device. Then, I can never get the interface back up and have to reboot. Note: I tried this with my network cable unplugged and the 8139too and got different messages. Do continue investigating since a reboot is required. |
|
Driver load timing
tests %
lsmod | grep ipw2100
<- Verify ipw2100 module is not loaded. |
Pass |
|
Driver load timing
tests2
% lsmod | grep ipw2100
<- Verify ipw2100 module is not loaded. |
Pass |
|
System Restart Configure system to load driver on startup, restart machine, and verify driver is loaded. |
Pass |
|
System load tests
% find / & |
Pass |
|
Driver unload
Hardware - ipw2100 laptop with 802.11b wireless capabilities. Most tests assume you have loaded the firmware as described in INSTALL before v to load the driver. Tests also assume you are using eth1. All tests below are performed as root on laptop. |
|
|
modprobe
tests
% lsmod |
grep ipw2100
<- Verify
ipw2100 module is loaded. |
Pass Issues After I do the 'ifdown eth1,' 'ifconfig eth1' still shows data. 'ifconfig' shows nothing. Is this an 'ifconfig' issue?
|
|
rmmod
tests
% lsmod |
grep ipw2100
<- Verify
ipw2100 module is loaded. |
Pass |
|
Remove before network
down %
ifconfig eth1
<- Verify IP address is assigned (network is up) |
Pass |
|
System load tests
% find / & |
Pass |
|
System Restart tests
- Configure system to
not load driver on startup. With driver still loaded,
restart system. Verify driver not loaded on startup and no
errors received. |
SKIP |
|
Infrastructure Mode
STA Most tests assume you have loaded the firmware as described in INSTALL before attempting to load the driver. Tests also assume you are using eth1. These tests assume
that the driver is already loaded using:
AP (need 2 for some tests) Tests assume AP is configured using its web interface as described in the AP's manual. Tests assume AP's SSID is <APSSID> All tests below are performed as root on laptop. |
|
|
Basic test
AP: Configure for
channel 4, and open authentication. Driver: % ping
<machine on network> -I eth1
<- Verify ping fails
because SSID hasn't been configured yet. |
Pass |
|
Association with invalid AP SSID % ifdown eth1 |
Pass Actually, what the ipw2100 does is it must recognize that that's an invalid SSID and associates with the next best thing. This sounds like expected behavior. |
|
Association with two
APs AP1 - Set
SSID to APSSID1; set channel to 3 % ifdown eth1 |
Pass Issues ISSUE 938926 in DB - It appears that the nearest SSID is generally the one associated with, and the essid command does not matter. I was told that this is because the essid command isn't binding, but the nwid command is. However, since we currently don't support nwid, I added this issue into the DB. |
|
APs off
Driver: AP: Turn AP off.
Driver: Ensure that the only error message received is the one stating the AP cannot be found (I get a ping failure for this.) Note: There was a regression where loading when not in range of AP gave ipw2100: Fatal interrupt. Scheduling firmware restart. ipw2100: eth1: Restarting adapter. errors. |
SKIP - can't find a place with no APs nearby to test |
|
BSS network test Ensure two machines on the AP's network can share data (either a text file or web page). |
Pass |
|
BSS transition test In an area with multiple APs configured:
%
modprobe ipw2100 |
SKIP - I'd have to walk too far, but keep this in mind for when I get the chance. |
|
WEP Association AP: Configure for
channel 4, and open authentication. Driver: % ping
<machine on network> -I eth1
<- Verify ping fails
because SSID hasn't been configured yet. |
Pass Works, except if I do 'ifup eth1,' I end up associating with the nearest non-WEP AP. The only way that I can get WEP to work is if I let my machine auto associate as in 935969. Not sure if this is a bug ore not. |
|
Fragmentation - Tx and
Rx
Hardware - ipw2100 laptop with 802.11b wireless capabilities. Tests assume you have loaded the firmware as described in INSTALL before attempting to load the driver. Tests assume debug output is compiled in. Tests also assume you are using eth1. These tests assume
that the driver is already loaded using: All tests below are performed as root on laptop. Before running tests, set /proc/net/ipw2100/debug_level to 8192 in order to display debug info when fragmentation is occurring (and verify the code path of the test). |
|
|
Basic transmit (Tx)
test
% iwconfig eth1
frag 300 |
Pass Note from James about Tx excessive retries: In looking at the
code, it appears we are actually reporting the wrong statistic
here. Currently, iwconfig is displaying the number of Tx
retries--but not the # of retries that exceed the retry limits
(which is what I believe iwconfig really wants). |
|
Basic receive (Rx)
test %
iwconfig eth1 frag off |
Pass It's not saying that fragmentation occurred with dmesg. But, should it? (since this is at the AP) Well, after a while, I get the message "expiring fragment cache entry seq=151 last_frag=2" |
|
Repeat Repeat above two tests with a different fragmentation threshold (ex. 290, 2200) --> range is 256-2346 |
Tx -
Pass Rx - Pass |
|
RTS/CTS
% echo "768" >
/proc/net/ipw2100/debug_level Repeat with packet size 1000, pinging 500, 1000, 1500. |
Pass Except, I have no way of knowing RTS actually happened. |
|
WEP Tests
Run through all tests
above, except enable WEP on the AP, and on the driver do the
extra step of: |
Tx -
Fail ISSUE 939689
in DB Rx - Pass Repeat for larger values - Tx - didn't try; Rx - Pass RTS/CTS - Pass |
|
Fragmentation fixed
test
% iwconfig eth1 frag
fixed |
Fail ISSUE 931399
in DB It doesn't appear to have a fixed setting. Fixed appears to do nothing. Updated issue 931399 in DB. |
|
Fragmentation auto
test
% iwconfig eth1 frag
auto |
Fail - ISSUE 931399 in DB |
|
Fragmentation off test
% iwconfig eth1 frag
off |
Pass |
|
Adhoc Not doing these tests now, since ad hoc support is not yet available. |
|
| TODO - Complete this | SKIP |
|
WEP
Hardware - ipw2100 laptop with 802.11b wireless capabilities. Tests assume you have loaded the firmware as described in INSTALL before attempting to load the driver. Tests assume debug output is compiled in. Tests also assume you are using eth1. Tests assume WEP is compiled in. All tests below are performed as root on laptop. |
|
|
Data Tx test On laptop connected to an AP via WEP, do:
% scp < <1Mb
file> machine_on_network
<- Verify data is
received on the other end using md5sum. |
Pass I only did for the 1 and 500Mb b/c of time. It would be nice to do a 'date' before and after to know exactly how long this transfer is taking as well. (Would also be good to time with and without WEP.) Would also be nice to get power consumption during these tests. |
|
Data Rx test On laptop connected to an AP via WEP, do:
% scp
machine_on_network:< <1Mb file> .
<- Verify data
is received on the other end using md5sum. |
Pass I only did for the 1Mb. The 500Mb took _way_ too long. Should get data on this and document as a potential issue. |
|
Non-WEP enabled AP With a laptop configured to use a key, try to associate with an AP that does not have WEP enabled. Verify association takes place, and 'iwconfig' shows that encryption has been turned off. |
Pass |
|
Kernel messages
Hardware - ipw2100 laptop with 802.11b wireless capabilities. Tests assume you have loaded the firmware as described in INSTALL before attempting to load the driver. Tests assume debug output is compiled in. Tests also assume you are using eth1. All tests below are performed as root on laptop. |
|
|
- For every test where
applicable, check the kernel log messages to ensure they are
valid. |
Pass |
| User space tools | |
|
iwconfig - Parameter
and functionality tests
Hardware - ipw2100 laptop with 802.11b wireless capabilities. Tests assume you have loaded the firmware as described in INSTALL before attempting to load the driver. Tests also assume you are using eth1. All tests below are performed as root on laptop. |
|
| iwconfig parameter tests | |
| iwconfig
basic test -
iwconfig
eth1 Regression issue where Noise level wasn't being set correctly. Should be fixed after 0.38. eth1 IEEE 802.11b ESSID:"ESSID" Nickname:"nickname"
Mode:Managed Channel:0 Access Point: 00:00:00:00:00:00
Bit Rate=0kb/s Tx-Power=0 dBm
Retry:on RTS thr=2304 B Fragment thr:2332 B
Encryption key:off
Link Quality:0/0 Signal level:-90 dBm Noise level:-75 dBm
Rx invalid nwid:0 Rx invalid crypt:0 Rx invalid frag:0
Tx excessive retries:0 Invalid misc:0 Missed beacon:0
|
Pass |
| iwconfig
essid -
iwconfig
eth1 essid <-
Verify error message received because blank |
Pass |
|
iwconfig nwid
-
iwconfig eth1 nwid <valid network id> - iwconfig eth1 nwid on; iwconfig eth1 nwid off --> Do not run until promiscuous mode enabled. |
FAIL See ISSUE 938926 for a mention of this |
| iwconfig
freq Just do some parameter testing: -
iwconfig eth1
freq 2.333G |
FAIL ISSUE
935971 in DB None of my changes are taken, and the ones that should error aren't. |
| iwconfig
chan Just do some parameter testing: -
iwconfig eth1 channel 1000 |
FAIL added
comment to ISSUE
935971 in DB I have no clue why I marked this pass last time. I suspect it may have been failing with 0.40-pre2 as well. |
| iwconfig
sens - iwconfig eth1 sens -## Set the threshold to be various values and ensure correct behavior (or error messages received): 0, 80, 120, 1000, -1 |
FAIL ISSUE 935972 in DB |
| iwconfig
mode Just do parameter testing to verify all can be set. Don't test functionality as not all is available yet. -
iwconfig eth1
mode ad-hoc
The tests below do not change the mode. That should be
fine since these will probably not be supported.
|
Pass |
| iwconfig
ap Just parameter testing: -
iwconfig eth1 ap
<valid AP> |
FAIL
Not sure if this is a bug or not. AP command doesn't seem to set the AP (I thought it did previously.). |
| iwconfig
nick Perform tests listed above for essid, except replace essid with 'nickname' |
Pass |
| iwconfig
rate Note: These tests only work on cards that support multiple bit rates. Just perform parameter testing, such as: -
iwconfig eth1
rate 11M |
SKIP - my card doesn't support |
| iwconfig
rts Just do parameter testing with numbers -1 (should fail), 0 (should fail), 250, auto, fixed, off. Other tests need to verify this functionality. |
Pass/FAIL
ISSUE 940158 in DB Doesn't look like auto or off are supported yet. Need to write this into DB (will do with next week's test pass). |
| iwconfig frag Do parameter testing with -1 (should fail), 0 (should fail), 1 (should fail), 270, 1000, 3000 (should fail). |
Pass |
| iwconfig
key - Test
that you can change which key is the active key. |
Pass |
| iwconfig
power
Just do parameter tests around the five key parameters to ensure that the mapping from input to five key values is valid. |
SKIP - will do next week |
| iwconfig
txpower
TODO - Add these tests when power management has been implemented. |
SKIP |
| iwconfig
retry
-
iwconfig eth1
retry 5 |
SKIP - I really need to expand this test to verify that the retry functionality is being used. |
| iwconfig
commit
No tests. Use this when running tests and want to ensure commits have taken place. |
FAIL ISSUE 935974 in DB |
| iwconfig functionality tests | |
|
iwconfig with no AP
% ifdown eth1 |
SKIP |
| iwlist - These are just basic functionality tests for now (low priority testing) | |
| %
iwlist eth1 scanning Ensure that all APs and ad-hoc cells in range are listed. |
Pass |
| %
iwlist eth1 frequency Ensure that available frequencies are listed. |
Pass |
| %
iwlist eth1 channel Ensure that available channels are listed. |
Pass |
| %
iwlist eth1 bitrate Ensure that supported bit rates are listed. |
Pass |
| %
iwlist eth1 rate Ensure that supported rates are listed. |
Pass |
| %
iwlist eth1 encryption Ensure that encryption key sizes and keys available are displayed. |
Pass May want to add these to WEP tests. |
| %
iwlist eth1 key Ensure that encryption key sizes and keys available are displayed. |
Pass May want to add these to WEP tests. |
| %
iwlist eth1 power Ensure that power management attributes and modes are listed. |
Pass |
| %
iwlist eth1 txpower Ensure that transmit power available is listed. |
Pass Says nothing, which is to be expected until functionality is added. |
| %
iwlist eth1 retry Ensure that retry limits and retry lifetime is listed. |
SKIP |
| iwspy | |
| iwspy - TODO |
SKIP
Doesn't appear to be supported yet. |
| iwpriv | |
| iwpriv - TODO |
SKIP
Doesn't appear to be supported yet. |
|
Power Management
Hardware - ipw2100 laptop with 802.11b wireless capabilities. Tests assume you have loaded the firmware as described in INSTALL before attempting to load the driver. Tests assume debug output is compiled in. Tests also assume you are using eth1. All tests below are performed as root on laptop. Tests assume: |
|
|
Off and On
Something about: |
SKIP - wrote issue 940290 in DB - Need to learn more before running through a full test pass with these. |
|
Period between wakeup
Something about: |
SKIP - wrote issue 940290 in DB - Need to learn more before running through a full test pass with these. |
|
Timeout before sleep
Something about: |
SKIP - wrote issue 940290 in DB - Need to learn more before running through a full test pass with these. |
|
All packets
Something about: |
SKIP - wrote issue 940290 in DB - Need to learn more before running through a full test pass with these. |
|
Unicast packets
Something about: |
SKIP - wrote issue 940290 in DB - Need to learn more before running through a full test pass with these. |
|
Multicast packets
Something about: |
SKIP - wrote issue 940290 in DB - Need to learn more before running through a full test pass with these. |
|
Min and Max
Something about: |
SKIP - wrote issue 940290 in DB - Need to learn more before running through a full test pass with these. |
|
Performance/Stress
Hardware - ipw2100 laptop with 802.11b wireless capabilities. Tests assume you have loaded the firmware as described in INSTALL before attempting to load the driver. Tests assume debug output is compiled in. Tests also assume you are using eth1. All tests below are performed as root on laptop. |
|
|
High Tx and Rx rate TBD the steps |
SKIP |
|
High CPU load TBD the steps |
SKIP |
|
Tests with pre-emption
disabled TBD the steps |
SKIP |
|
Interferance test
% ping -c 3 -I eth1 -s 400 <machine on network> |
SKIP |
| Network throughput performance tests | See automated test suite. |
| Power consumption when unplugged tests. | See automated test suite. |
|
Collision detection
test This test is the closest we get to verifying that fragmentation actually occurs. Set up collision monitor tool to monitor the number of collisions on the network. Run through Tx and Rx tests with the fragmentation threshold set to various values between 256 and 2, 048 bytes. Ensure that the collision rate is smaller when the fragmentation threshold is smaller. |
SKIP |
|
RTS/CTS Two
Machines Verify that RTS/CTS
works by: |
SKIP |
| One off list - Until root cause is known, watch mailing list for frequency of user citing. | |
|
Corrupt payload issue
(C3 related) Enable C3. After using the system for a while look for a "Packet Payload Too Large" message in the kernel log followed by a firmware reset. Log how often this happens. Workaround is to disable C3 (either via the patch on the website to processor.c or by unloading the ACPI processor module). |
SKIP |
|
Fatal interrupt
(unknown cause):
After testing, check
the kernel log for a message like: Log how often this happens. |
Saw this 1-2 times
this test pass. Saw on another tester's machine when the old version of iwconfig tools was used. |
| Tools | |
| - Use ifplugd (http://www.stud.uni-hamburg.de/users/lennart/projects/ifplugd/) to automatically initiate module loading and connect. | SKIP |
| Suspend/Resume/Power Control | |
|
Suspend machine
running machine and ensure system works as expected when
resumed. TODO - Expand this test as well as this section. Need to find a way to easily go into suspend. Could use apmsleep -s and -S, but I'd need to compile them into the kernel. |
SKIP |
| Wait for processor to go into save power state. Check logs to ensure link was always available. (Regression issue where link went down for a few seconds during suspend.) | SKIP |
|
av5100
LED verification %
modprobe av5100
<- Verify radio LED
turns on (will blink when coming up) |
Pass |
| Install/Uninstall Testing | |
| Fedora 1 -- 2.6.5 kernel: Inside Kernel | Pass |
| Fedora 1 -- 2.6.5 kernel: Outside Kernel | Pass |
| Suse 9 -- 2.6.5 kernel: Inside Kernel | Pass |
| Suse 9 -- 2.6.5 kernel: Outside Kernel | FAIL |
| Debian 3 -- 2.6.4 kernel: Inside Kernel | FAIL |
| Debian 3 -- 2.6.4 kernel: Outside Kernel | Pass |
| Debian 3 -- 2.4.26 kernel: Inside kernel | FAIL |
| Debian 3 -- 2.4.26 kernel: Outside Kernel | SKIP |
| Gentoo 2.6: Inside Kernel | Pass |
| Gentoo 2.6: Outside Kernel | Pass |
| Gentoo 2.4 kernel: Inside Kernel: | FAIL |
| Gentoo 2.6: Outside Kernel: | SKIP |
| RedHat 9 -- 2.4.26 kernel: Inside kernel: | SKIP |
| RedHat 9 -- 2.4.26 kernel: Outside Kernel: | FAIL |
| README verification | |
| Content verification | SKIP |
| TODO section | |
This section lists the
items that have not been covered yet.
|
N/A |
Copyright (c) 2004 Intel Corporation. All rights reserved.